Use of palette file: Problems with changing colors when tiling

[Espen Isaksen]

Hi!

We are testing out using a palette file in our outputformat to
decrease file size in the png output. Most of the time this works
great, but some times when we are tiling the data we get some errors.
The color seem to shift to a similar color from one tile to another.

We have added the colors we use in the map file in the palette.txt
file. The documentation says it needs 256 colors in the map file, but
we do not use that many colors right now. (we tried adding the same
color more than one time, but that created other problems....)

I have attached a png file showing the problem across a lake. The
color on the right side is the correct color and the color we have
added to the palette file. The color on the left side of the lake is
not something we have set.

I have also added the palette.txt file and the outputformat we use is this:

         OUTPUTFORMAT
                        NAME             "png"
                        DRIVER           "AGG/PNG"
                        MIMETYPE         "image/png"
                        IMAGEMODE        "rgb"
                        EXTENSION        "png"
                        FORMATOPTION     "PALETTE_FORCE=TRUE"
                        FORMATOPTION     "PALETTE=/data/maps/palette.txt"
                 END

Does anybody know why this happens in Mapserver and how to fix it?

Espen

0,0,0
0,0,224
0,0,255
0,153,0
0,208,104
100,100,100
100,100,255
10,10,10
102,102,102
102,51,51
105,105,105
108,189,243
108,190,232
109,187,239
110,110,110
115,117,208
119,215,81
123,123,123
128,0,128
130,130,130
135,151,115
140,140,140
144,108,0
144,238,144
150,150,150
150,80,0
152,251,152
153,102,0
153,102,102
153,102,51
153,153,153
153,204,102
153,204,255
153,255,255
160,160,160
175,175,175
176,78,239
177,177,168
178,157,30
180,156,30
180,180,180
1,80,195
182,231,182
184,255,166
187,187,187
190,190,170
192,192,0
194,255,166
196,255,188
200,200,145
200,200,200
20,20,141
20,20,20
202,193,176
204,102,153
204,153,102
204,84,39
210,150,60
210,180,140
211,211,211
215,215,215
216,245,203
217,64,51
219,219,183
220,220,200
220,220,220
223,217,197
230,230,230
230,234,80
231,232,24
235,163,89
235,235,235
240,240,240
244,213,66
246,246,77
246,252,195
248,248,201
250,250,250
25,25,25
253,163,30
25,32,24
253,240,196
255,0,0
255,0,255
255,144,0
255,153,204
255,165,0
255,231,208
255,246,77
255,255,102
255,255,204
255,255,255
255,255,51
255,255,68
255,255,69
25,69,125
30,30,30
50,50,50
51,102,204
51,153,0
51,153,102
51,153,255
57,105,141
60,60,60
73,101,54
74,164,22
79,162,68
80,120,220
80,80,80
84,86,220
87,118,69
90,40,30
98,98,93


_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Thomas Bonfort-2]

is the blue of your lake inside your palette.txt ?
if so, you shouldn't be getting those discrepancies.

regards,

thomas
www.camptocamp.com
[phone]



On Wed, Oct 28, 2009 at 11:25, Espen Isaksen <[hidden email]> wrote:

> Hi!
>
> We are testing out using a palette file in our outputformat to
> decrease file size in the png output. Most of the time this works
> great, but some times when we are tiling the data we get some errors.
> The color seem to shift to a similar color from one tile to another.
>
> We have added the colors we use in the map file in the palette.txt
> file. The documentation says it needs 256 colors in the map file, but
> we do not use that many colors right now. (we tried adding the same
> color more than one time, but that created other problems....)
>
> I have attached a png file showing the problem across a lake. The
> color on the right side is the correct color and the color we have
> added to the palette file. The color on the left side of the lake is
> not something we have set.
>
> I have also added the palette.txt file and the outputformat we use is this:
>
>         OUTPUTFORMAT
>                        NAME             "png"
>                        DRIVER           "AGG/PNG"
>                        MIMETYPE         "image/png"
>                        IMAGEMODE        "rgb"
>                        EXTENSION        "png"
>                        FORMATOPTION     "PALETTE_FORCE=TRUE"
>                        FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>                 END
>
> Does anybody know why this happens in Mapserver and how to fix it?
>
> Espen
>
> _______________________________________________
> mapserver-users mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Steve Lime]

Is the color 125,202,228 (the water value in the image on the left) used in your mapfile?

>>> On 10/28/2009 at 5:25 AM, in message
<[hidden email]>, Espen Isaksen
<[hidden email]> wrote:

> Hi!
>
> We are testing out using a palette file in our outputformat to
> decrease file size in the png output. Most of the time this works
> great, but some times when we are tiling the data we get some errors.
> The color seem to shift to a similar color from one tile to another.
>
> We have added the colors we use in the map file in the palette.txt
> file. The documentation says it needs 256 colors in the map file, but
> we do not use that many colors right now. (we tried adding the same
> color more than one time, but that created other problems....)
>
> I have attached a png file showing the problem across a lake. The
> color on the right side is the correct color and the color we have
> added to the palette file. The color on the left side of the lake is
> not something we have set.
>
> I have also added the palette.txt file and the outputformat we use is this:
>
>          OUTPUTFORMAT
>                         NAME             "png"
>                         DRIVER           "AGG/PNG"
>                         MIMETYPE         "image/png"
>                         IMAGEMODE        "rgb"
>                         EXTENSION        "png"
>                         FORMATOPTION     "PALETTE_FORCE=TRUE"
>                         FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>                  END
>
> Does anybody know why this happens in Mapserver and how to fix it?
>
> Espen

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Thomas Bonfort-2]

even if it was used in the mapfile, the exact value of the water color
should have been chosen given it was present in the initial palette.



On Wed, Oct 28, 2009 at 22:16, Steve Lime <[hidden email]> wrote:

> Is the color 125,202,228 (the water value in the image on the left) used in your mapfile?
>
>>>> On 10/28/2009 at 5:25 AM, in message
> <[hidden email]>, Espen Isaksen
> <[hidden email]> wrote:
>> Hi!
>>
>> We are testing out using a palette file in our outputformat to
>> decrease file size in the png output. Most of the time this works
>> great, but some times when we are tiling the data we get some errors.
>> The color seem to shift to a similar color from one tile to another.
>>
>> We have added the colors we use in the map file in the palette.txt
>> file. The documentation says it needs 256 colors in the map file, but
>> we do not use that many colors right now. (we tried adding the same
>> color more than one time, but that created other problems....)
>>
>> I have attached a png file showing the problem across a lake. The
>> color on the right side is the correct color and the color we have
>> added to the palette file. The color on the left side of the lake is
>> not something we have set.
>>
>> I have also added the palette.txt file and the outputformat we use is this:
>>
>>          OUTPUTFORMAT
>>                         NAME             "png"
>>                         DRIVER           "AGG/PNG"
>>                         MIMETYPE         "image/png"
>>                         IMAGEMODE        "rgb"
>>                         EXTENSION        "png"
>>                         FORMATOPTION     "PALETTE_FORCE=TRUE"
>>                         FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>                  END
>>
>> Does anybody know why this happens in Mapserver and how to fix it?
>>
>> Espen
>
> _______________________________________________
> mapserver-users mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Espen Isaksen]

No, that color is not present in the mapfile or in the palette.txt
file. We use the color 108 189 243 on lakes.

This is happening on other features(with other colors) for us as well.

I did test to fill up the palette file with the same colors more than
one time in order to get 256 colers in the file and that actually
fixed the problem. However, it created all other kind of problems with
the colors, especially with anti-aliasing on labels.

Espen



2009/10/28 Steve Lime <[hidden email]>:

> Is the color 125,202,228 (the water value in the image on the left) used in your mapfile?
>
>>>> On 10/28/2009 at 5:25 AM, in message
> <[hidden email]>, Espen Isaksen
> <[hidden email]> wrote:
>> Hi!
>>
>> We are testing out using a palette file in our outputformat to
>> decrease file size in the png output. Most of the time this works
>> great, but some times when we are tiling the data we get some errors.
>> The color seem to shift to a similar color from one tile to another.
>>
>> We have added the colors we use in the map file in the palette.txt
>> file. The documentation says it needs 256 colors in the map file, but
>> we do not use that many colors right now. (we tried adding the same
>> color more than one time, but that created other problems....)
>>
>> I have attached a png file showing the problem across a lake. The
>> color on the right side is the correct color and the color we have
>> added to the palette file. The color on the left side of the lake is
>> not something we have set.
>>
>> I have also added the palette.txt file and the outputformat we use is this:
>>
>>          OUTPUTFORMAT
>>                         NAME             "png"
>>                         DRIVER           "AGG/PNG"
>>                         MIMETYPE         "image/png"
>>                         IMAGEMODE        "rgb"
>>                         EXTENSION        "png"
>>                         FORMATOPTION     "PALETTE_FORCE=TRUE"
>>                         FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>                  END
>>
>> Does anybody know why this happens in Mapserver and how to fix it?
>>
>> Espen
>
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Stephen Woodbridge]

The correct usage of the palette file is to NOT fill it up with 256
colors. What you want to do it get all the colors that you explicitly
reference in the mapfile and place them in the palette file. then
mapserver will initiate you file with these colors. Then when you
antialias something mapserver will use the remain color slots and fill
them with the antialiased generated colors.

-Steve W

Espen Isaksen wrote:

> No, that color is not present in the mapfile or in the palette.txt
> file. We use the color 108 189 243 on lakes.
>
> This is happening on other features(with other colors) for us as well.
>
> I did test to fill up the palette file with the same colors more than
> one time in order to get 256 colers in the file and that actually
> fixed the problem. However, it created all other kind of problems with
> the colors, especially with anti-aliasing on labels.
>
> Espen
>
>
>
> 2009/10/28 Steve Lime <[hidden email]>:
>> Is the color 125,202,228 (the water value in the image on the left) used in your mapfile?
>>
>>>>> On 10/28/2009 at 5:25 AM, in message
>> <[hidden email]>, Espen Isaksen
>> <[hidden email]> wrote:
>>> Hi!
>>>
>>> We are testing out using a palette file in our outputformat to
>>> decrease file size in the png output. Most of the time this works
>>> great, but some times when we are tiling the data we get some errors.
>>> The color seem to shift to a similar color from one tile to another.
>>>
>>> We have added the colors we use in the map file in the palette.txt
>>> file. The documentation says it needs 256 colors in the map file, but
>>> we do not use that many colors right now. (we tried adding the same
>>> color more than one time, but that created other problems....)
>>>
>>> I have attached a png file showing the problem across a lake. The
>>> color on the right side is the correct color and the color we have
>>> added to the palette file. The color on the left side of the lake is
>>> not something we have set.
>>>
>>> I have also added the palette.txt file and the outputformat we use is this:
>>>
>>>          OUTPUTFORMAT
>>>                         NAME             "png"
>>>                         DRIVER           "AGG/PNG"
>>>                         MIMETYPE         "image/png"
>>>                         IMAGEMODE        "rgb"
>>>                         EXTENSION        "png"
>>>                         FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>                         FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>                  END
>>>
>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>
>>> Espen
>>
> _______________________________________________
> mapserver-users mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapserver-users

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Espen Isaksen]

Yes, we know, but we just tried to bypass the problem by fooling
Mapserver. And that did not work :-) That was just a test, which might
show that Mapserver is filling in some Mapserver defined color in the
waterlayer when it shouldn't.

Espen


2009/10/29 Stephen Woodbridge <[hidden email]>:

> The correct usage of the palette file is to NOT fill it up with 256 colors.
> What you want to do it get all the colors that you explicitly reference in
> the mapfile and place them in the palette file. then mapserver will initiate
> you file with these colors. Then when you antialias something mapserver will
> use the remain color slots and fill them with the antialiased generated
> colors.
>
> -Steve W
>
> Espen Isaksen wrote:
>>
>> No, that color is not present in the mapfile or in the palette.txt
>> file. We use the color 108 189 243 on lakes.
>>
>> This is happening on other features(with other colors) for us as well.
>>
>> I did test to fill up the palette file with the same colors more than
>> one time in order to get 256 colers in the file and that actually
>> fixed the problem. However, it created all other kind of problems with
>> the colors, especially with anti-aliasing on labels.
>>
>> Espen
>>
>>
>>
>> 2009/10/28 Steve Lime <[hidden email]>:
>>>
>>> Is the color 125,202,228 (the water value in the image on the left) used
>>> in your mapfile?
>>>
>>>>>> On 10/28/2009 at 5:25 AM, in message
>>>
>>> <[hidden email]>, Espen
>>> Isaksen
>>> <[hidden email]> wrote:
>>>>
>>>> Hi!
>>>>
>>>> We are testing out using a palette file in our outputformat to
>>>> decrease file size in the png output. Most of the time this works
>>>> great, but some times when we are tiling the data we get some errors.
>>>> The color seem to shift to a similar color from one tile to another.
>>>>
>>>> We have added the colors we use in the map file in the palette.txt
>>>> file. The documentation says it needs 256 colors in the map file, but
>>>> we do not use that many colors right now. (we tried adding the same
>>>> color more than one time, but that created other problems....)
>>>>
>>>> I have attached a png file showing the problem across a lake. The
>>>> color on the right side is the correct color and the color we have
>>>> added to the palette file. The color on the left side of the lake is
>>>> not something we have set.
>>>>
>>>> I have also added the palette.txt file and the outputformat we use is
>>>> this:
>>>>
>>>>         OUTPUTFORMAT
>>>>                        NAME             "png"
>>>>                        DRIVER           "AGG/PNG"
>>>>                        MIMETYPE         "image/png"
>>>>                        IMAGEMODE        "rgb"
>>>>                        EXTENSION        "png"
>>>>                        FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>                        FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>                 END
>>>>
>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>
>>>> Espen
>>>
>> _______________________________________________
>> mapserver-users mailing list
>> [hidden email]
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Espen Isaksen]

Justed wanted to bring this question into attention again since we did
not get a solution to the problem, and we have not found one either.

Could this possibly be a bug in Mapserver? Should we report it?

Espen



2009/10/28 Espen Isaksen <[hidden email]>:

> Hi!
>
> We are testing out using a palette file in our outputformat to
> decrease file size in the png output. Most of the time this works
> great, but some times when we are tiling the data we get some errors.
> The color seem to shift to a similar color from one tile to another.
>
> We have added the colors we use in the map file in the palette.txt
> file. The documentation says it needs 256 colors in the map file, but
> we do not use that many colors right now. (we tried adding the same
> color more than one time, but that created other problems....)
>
> I have attached a png file showing the problem across a lake. The
> color on the right side is the correct color and the color we have
> added to the palette file. The color on the left side of the lake is
> not something we have set.
>
> I have also added the palette.txt file and the outputformat we use is this:
>
>         OUTPUTFORMAT
>                        NAME             "png"
>                        DRIVER           "AGG/PNG"
>                        MIMETYPE         "image/png"
>                        IMAGEMODE        "rgb"
>                        EXTENSION        "png"
>                        FORMATOPTION     "PALETTE_FORCE=TRUE"
>                        FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>                 END
>
> Does anybody know why this happens in Mapserver and how to fix it?
>
> Espen
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Thomas Bonfort-2]

Stephen Woodbridge replied to this thread, and gave the correct usage
of the palette file: set the same colors in your palette file as in
your mapfile.

regards,

thomas

www.camptocamp.com
[phone]



On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]> wrote:

> Justed wanted to bring this question into attention again since we did
> not get a solution to the problem, and we have not found one either.
>
> Could this possibly be a bug in Mapserver? Should we report it?
>
> Espen
>
>
>
> 2009/10/28 Espen Isaksen <[hidden email]>:
>> Hi!
>>
>> We are testing out using a palette file in our outputformat to
>> decrease file size in the png output. Most of the time this works
>> great, but some times when we are tiling the data we get some errors.
>> The color seem to shift to a similar color from one tile to another.
>>
>> We have added the colors we use in the map file in the palette.txt
>> file. The documentation says it needs 256 colors in the map file, but
>> we do not use that many colors right now. (we tried adding the same
>> color more than one time, but that created other problems....)
>>
>> I have attached a png file showing the problem across a lake. The
>> color on the right side is the correct color and the color we have
>> added to the palette file. The color on the left side of the lake is
>> not something we have set.
>>
>> I have also added the palette.txt file and the outputformat we use is this:
>>
>>         OUTPUTFORMAT
>>                        NAME             "png"
>>                        DRIVER           "AGG/PNG"
>>                        MIMETYPE         "image/png"
>>                        IMAGEMODE        "rgb"
>>                        EXTENSION        "png"
>>                        FORMATOPTION     "PALETTE_FORCE=TRUE"
>>                        FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>                 END
>>
>> Does anybody know why this happens in Mapserver and how to fix it?
>>
>> Espen
>>
> _______________________________________________
> mapserver-users mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Espen Isaksen]

Yes, that is what we have been doing all along. I guess I never should
have mentioned our testing with putting lots of colors in the palette
file, as it just confuses people :-)

So forget our testing, we have only put the colors we use in the
mapfile once in the palette file(attached in the first mail), and the
error in the color is like on the map I attached(first mail).

Espen



2009/11/6 Thomas Bonfort <[hidden email]>:

> Stephen Woodbridge replied to this thread, and gave the correct usage
> of the palette file: set the same colors in your palette file as in
> your mapfile.
>
> regards,
>
> thomas
>
> www.camptocamp.com
> [phone]
>
>
>
> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]> wrote:
>> Justed wanted to bring this question into attention again since we did
>> not get a solution to the problem, and we have not found one either.
>>
>> Could this possibly be a bug in Mapserver? Should we report it?
>>
>> Espen
>>
>>
>>
>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>> Hi!
>>>
>>> We are testing out using a palette file in our outputformat to
>>> decrease file size in the png output. Most of the time this works
>>> great, but some times when we are tiling the data we get some errors.
>>> The color seem to shift to a similar color from one tile to another.
>>>
>>> We have added the colors we use in the map file in the palette.txt
>>> file. The documentation says it needs 256 colors in the map file, but
>>> we do not use that many colors right now. (we tried adding the same
>>> color more than one time, but that created other problems....)
>>>
>>> I have attached a png file showing the problem across a lake. The
>>> color on the right side is the correct color and the color we have
>>> added to the palette file. The color on the left side of the lake is
>>> not something we have set.
>>>
>>> I have also added the palette.txt file and the outputformat we use is this:
>>>
>>>         OUTPUTFORMAT
>>>                        NAME             "png"
>>>                        DRIVER           "AGG/PNG"
>>>                        MIMETYPE         "image/png"
>>>                        IMAGEMODE        "rgb"
>>>                        EXTENSION        "png"
>>>                        FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>                        FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>                 END
>>>
>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>
>>> Espen
>>>
>> _______________________________________________
>> mapserver-users mailing list
>> [hidden email]
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Stephen Woodbridge]

Espen,

Try using this:

     OUTPUTFORMAT
         NAME agg
         DRIVER "AGG/PNG"
         MIMETYPE "image/png"
         IMAGEMODE RGB
         FORMATOPTION "INTERLACE=false"
         FORMATOPTION "QUANTIZE_FORCE=ON"
         FORMATOPTION "QUANTIZE_DITHER=OFF"
         FORMATOPTION "QUANTIZE_COLORS=256"
         FORMATOPTION "PALETTE=/data/maps/palette.txt"
     END

And see if it does what you want. Also note that I use "ON" and note
"TRUE" as the value of "QUANTIZE_FORCE", but I'm not sure if the matters
or not.

-Steve

Espen Isaksen wrote:

> Yes, that is what we have been doing all along. I guess I never should
> have mentioned our testing with putting lots of colors in the palette
> file, as it just confuses people :-)
>
> So forget our testing, we have only put the colors we use in the
> mapfile once in the palette file(attached in the first mail), and the
> error in the color is like on the map I attached(first mail).
>
> Espen
>
>
>
> 2009/11/6 Thomas Bonfort <[hidden email]>:
>> Stephen Woodbridge replied to this thread, and gave the correct usage
>> of the palette file: set the same colors in your palette file as in
>> your mapfile.
>>
>> regards,
>>
>> thomas
>>
>> www.camptocamp.com
>> [phone]
>>
>>
>>
>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]> wrote:
>>> Justed wanted to bring this question into attention again since we did
>>> not get a solution to the problem, and we have not found one either.
>>>
>>> Could this possibly be a bug in Mapserver? Should we report it?
>>>
>>> Espen
>>>
>>>
>>>
>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>> Hi!
>>>>
>>>> We are testing out using a palette file in our outputformat to
>>>> decrease file size in the png output. Most of the time this works
>>>> great, but some times when we are tiling the data we get some errors.
>>>> The color seem to shift to a similar color from one tile to another.
>>>>
>>>> We have added the colors we use in the map file in the palette.txt
>>>> file. The documentation says it needs 256 colors in the map file, but
>>>> we do not use that many colors right now. (we tried adding the same
>>>> color more than one time, but that created other problems....)
>>>>
>>>> I have attached a png file showing the problem across a lake. The
>>>> color on the right side is the correct color and the color we have
>>>> added to the palette file. The color on the left side of the lake is
>>>> not something we have set.
>>>>
>>>> I have also added the palette.txt file and the outputformat we use is this:
>>>>
>>>>         OUTPUTFORMAT
>>>>                        NAME             "png"
>>>>                        DRIVER           "AGG/PNG"
>>>>                        MIMETYPE         "image/png"
>>>>                        IMAGEMODE        "rgb"
>>>>                        EXTENSION        "png"
>>>>                        FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>                        FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>                 END
>>>>
>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>
>>>> Espen
>>>>
>>> _______________________________________________
>>> mapserver-users mailing list
>>> [hidden email]
>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>
> _______________________________________________
> mapserver-users mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapserver-users

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Espen Isaksen]

Sorry, this still creates trouble. And you have omitted

FORMATOPTION "PALETTE_FORCE=TRUE"

on this one. That means it does not use the palette file right?

Espen


2009/11/6 Stephen Woodbridge <[hidden email]>:

> Espen,
>
> Try using this:
>
>    OUTPUTFORMAT
>        NAME agg
>        DRIVER "AGG/PNG"
>        MIMETYPE "image/png"
>        IMAGEMODE RGB
>        FORMATOPTION "INTERLACE=false"
>        FORMATOPTION "QUANTIZE_FORCE=ON"
>        FORMATOPTION "QUANTIZE_DITHER=OFF"
>        FORMATOPTION "QUANTIZE_COLORS=256"
>        FORMATOPTION "PALETTE=/data/maps/palette.txt"
>    END
>
> And see if it does what you want. Also note that I use "ON" and note "TRUE"
> as the value of "QUANTIZE_FORCE", but I'm not sure if the matters or not.
>
> -Steve
>
> Espen Isaksen wrote:
>>
>> Yes, that is what we have been doing all along. I guess I never should
>> have mentioned our testing with putting lots of colors in the palette
>> file, as it just confuses people :-)
>>
>> So forget our testing, we have only put the colors we use in the
>> mapfile once in the palette file(attached in the first mail), and the
>> error in the color is like on the map I attached(first mail).
>>
>> Espen
>>
>>
>>
>> 2009/11/6 Thomas Bonfort <[hidden email]>:
>>>
>>> Stephen Woodbridge replied to this thread, and gave the correct usage
>>> of the palette file: set the same colors in your palette file as in
>>> your mapfile.
>>>
>>> regards,
>>>
>>> thomas
>>>
>>> www.camptocamp.com
>>> [phone]
>>>
>>>
>>>
>>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]>
>>> wrote:
>>>>
>>>> Justed wanted to bring this question into attention again since we did
>>>> not get a solution to the problem, and we have not found one either.
>>>>
>>>> Could this possibly be a bug in Mapserver? Should we report it?
>>>>
>>>> Espen
>>>>
>>>>
>>>>
>>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>>>
>>>>> Hi!
>>>>>
>>>>> We are testing out using a palette file in our outputformat to
>>>>> decrease file size in the png output. Most of the time this works
>>>>> great, but some times when we are tiling the data we get some errors.
>>>>> The color seem to shift to a similar color from one tile to another.
>>>>>
>>>>> We have added the colors we use in the map file in the palette.txt
>>>>> file. The documentation says it needs 256 colors in the map file, but
>>>>> we do not use that many colors right now. (we tried adding the same
>>>>> color more than one time, but that created other problems....)
>>>>>
>>>>> I have attached a png file showing the problem across a lake. The
>>>>> color on the right side is the correct color and the color we have
>>>>> added to the palette file. The color on the left side of the lake is
>>>>> not something we have set.
>>>>>
>>>>> I have also added the palette.txt file and the outputformat we use is
>>>>> this:
>>>>>
>>>>>        OUTPUTFORMAT
>>>>>                       NAME             "png"
>>>>>                       DRIVER           "AGG/PNG"
>>>>>                       MIMETYPE         "image/png"
>>>>>                       IMAGEMODE        "rgb"
>>>>>                       EXTENSION        "png"
>>>>>                       FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>>                       FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>>                END
>>>>>
>>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>>
>>>>> Espen
>>>>>
>>>> _______________________________________________
>>>> mapserver-users mailing list
>>>> [hidden email]
>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>
>> _______________________________________________
>> mapserver-users mailing list
>> [hidden email]
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Steve Lime]

Correct. My palette creation process has been to:

1) create a master image that shows as many possible rendering outputs as possible as a 24-bit PNG.

2) use a tool to reduce the colors in that image to the desired number and create a 8-bit file. In my case
I use PhotoShop and produce a gif. Here's a link to the one I used for our rec. compass app but after
color reduction to 128 colors.

  http://maps.dnr.state.mn.us/compass/remove/compass_color_master.gif 

3) extract a palette from the 8-bit image. I wrote a little perl script that processes gdalinfo output.

4) my outputformat block is like so:

  OUTPUTFORMAT
    NAME png
    DRIVER "AGG/PNG"
    MIMETYPE "image/png"
    IMAGEMODE RGB
    EXTENSION "png"
    FORMATOPTION "INTERLACE=OFF"
    FORMATOPTION "PALETTE_FORCE=TRUE"
    FORMATOPTION "PALETTE=/mapserver/compass/compass.palette"
  END
 
I've not had problems with this method...

It's possible there's a bug but it's going to be difficult to fix without a good test case.

Steve

>>> On 11/6/2009 at 9:52 AM, in message
<[hidden email]>, Espen Isaksen
<[hidden email]> wrote:

> Sorry, this still creates trouble. And you have omitted
>
> FORMATOPTION "PALETTE_FORCE=TRUE"
>
> on this one. That means it does not use the palette file right?
>
> Espen
>
>
> 2009/11/6 Stephen Woodbridge <[hidden email]>:
>> Espen,
>>
>> Try using this:
>>
>>    OUTPUTFORMAT
>>        NAME agg
>>        DRIVER "AGG/PNG"
>>        MIMETYPE "image/png"
>>        IMAGEMODE RGB
>>        FORMATOPTION "INTERLACE=false"
>>        FORMATOPTION "QUANTIZE_FORCE=ON"
>>        FORMATOPTION "QUANTIZE_DITHER=OFF"
>>        FORMATOPTION "QUANTIZE_COLORS=256"
>>        FORMATOPTION "PALETTE=/data/maps/palette.txt"
>>    END
>>
>> And see if it does what you want. Also note that I use "ON" and note "TRUE"
>> as the value of "QUANTIZE_FORCE", but I'm not sure if the matters or not.
>>
>> -Steve
>>
>> Espen Isaksen wrote:
>>>
>>> Yes, that is what we have been doing all along. I guess I never should
>>> have mentioned our testing with putting lots of colors in the palette
>>> file, as it just confuses people :-)
>>>
>>> So forget our testing, we have only put the colors we use in the
>>> mapfile once in the palette file(attached in the first mail), and the
>>> error in the color is like on the map I attached(first mail).
>>>
>>> Espen
>>>
>>>
>>>
>>> 2009/11/6 Thomas Bonfort <[hidden email]>:
>>>>
>>>> Stephen Woodbridge replied to this thread, and gave the correct usage
>>>> of the palette file: set the same colors in your palette file as in
>>>> your mapfile.
>>>>
>>>> regards,
>>>>
>>>> thomas
>>>>
>>>> www.camptocamp.com
>>>> [phone]
>>>>
>>>>
>>>>
>>>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]>
>>>> wrote:
>>>>>
>>>>> Justed wanted to bring this question into attention again since we did
>>>>> not get a solution to the problem, and we have not found one either.
>>>>>
>>>>> Could this possibly be a bug in Mapserver? Should we report it?
>>>>>
>>>>> Espen
>>>>>
>>>>>
>>>>>
>>>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>>>>
>>>>>> Hi!
>>>>>>
>>>>>> We are testing out using a palette file in our outputformat to
>>>>>> decrease file size in the png output. Most of the time this works
>>>>>> great, but some times when we are tiling the data we get some errors.
>>>>>> The color seem to shift to a similar color from one tile to another.
>>>>>>
>>>>>> We have added the colors we use in the map file in the palette.txt
>>>>>> file. The documentation says it needs 256 colors in the map file, but
>>>>>> we do not use that many colors right now. (we tried adding the same
>>>>>> color more than one time, but that created other problems....)
>>>>>>
>>>>>> I have attached a png file showing the problem across a lake. The
>>>>>> color on the right side is the correct color and the color we have
>>>>>> added to the palette file. The color on the left side of the lake is
>>>>>> not something we have set.
>>>>>>
>>>>>> I have also added the palette.txt file and the outputformat we use is
>>>>>> this:
>>>>>>
>>>>>>        OUTPUTFORMAT
>>>>>>                       NAME             "png"
>>>>>>                       DRIVER           "AGG/PNG"
>>>>>>                       MIMETYPE         "image/png"
>>>>>>                       IMAGEMODE        "rgb"
>>>>>>                       EXTENSION        "png"
>>>>>>                       FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>>>                       FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>>>                END
>>>>>>
>>>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>>>
>>>>>> Espen
>>>>>>
>>>>> _______________________________________________
>>>>> mapserver-users mailing list
>>>>> [hidden email]
>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users 
>>>>>
>>> _______________________________________________
>>> mapserver-users mailing list
>>> [hidden email]
>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users 
>>
>>
> _______________________________________________
> mapserver-users mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapserver-users

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Stephen Woodbridge]

Ahh, in my example I removed "PALETTE_FORCE=TRUE" because I confused it
with "QUANTIZE_FORCE=ON".

I assume you can both force the palette and quantize at the same time?

Are "TRUE" and "ON" equivalent as far as FORMATOPTIONs go? I'm going to
guess not because I think these are NOT getting parsed by the mapfile
parser and are more likely getting parsed by the individual drivers.

-Steve W

Steve Lime wrote:

> Correct. My palette creation process has been to:
>
> 1) create a master image that shows as many possible rendering
> outputs as possible as a 24-bit PNG.
>
> 2) use a tool to reduce the colors in that image to the desired
> number and create a 8-bit file. In my case I use PhotoShop and
> produce a gif. Here's a link to the one I used for our rec. compass
> app but after color reduction to 128 colors.
>
> http://maps.dnr.state.mn.us/compass/remove/compass_color_master.gif
>
> 3) extract a palette from the 8-bit image. I wrote a little perl
> script that processes gdalinfo output.
>
> 4) my outputformat block is like so:
>
> OUTPUTFORMAT NAME png
>   DRIVER "AGG/PNG"

 >   MIMETYPE "image/png"
 >   IMAGEMODE RGB
 >   EXTENSION "png"
 >   FORMATOPTION "INTERLACE=OFF"
 >   FORMATOPTION "PALETTE_FORCE=TRUE"
 >   FORMATOPTION "PALETTE=/mapserver/compass/compass.palette"
 > END

>
> I've not had problems with this method...
>
> It's possible there's a bug but it's going to be difficult to fix
> without a good test case.
>
> Steve
>
>>>> On 11/6/2009 at 9:52 AM, in message
> <[hidden email]>, Espen
> Isaksen <[hidden email]> wrote:
>> Sorry, this still creates trouble. And you have omitted
>>
>> FORMATOPTION "PALETTE_FORCE=TRUE"
>>
>> on this one. That means it does not use the palette file right?
>>
>> Espen
>>
>>
>> 2009/11/6 Stephen Woodbridge <[hidden email]>:
>>> Espen,
>>>
>>> Try using this:
>>>
>>> OUTPUTFORMAT NAME agg DRIVER "AGG/PNG" MIMETYPE "image/png"
>>> IMAGEMODE RGB FORMATOPTION "INTERLACE=false" FORMATOPTION
>>> "QUANTIZE_FORCE=ON" FORMATOPTION "QUANTIZE_DITHER=OFF"
>>> FORMATOPTION "QUANTIZE_COLORS=256" FORMATOPTION
>>> "PALETTE=/data/maps/palette.txt" END
>>>
>>> And see if it does what you want. Also note that I use "ON" and
>>> note "TRUE" as the value of "QUANTIZE_FORCE", but I'm not sure if
>>> the matters or not.
>>>
>>> -Steve
>>>
>>> Espen Isaksen wrote:
>>>> Yes, that is what we have been doing all along. I guess I never
>>>> should have mentioned our testing with putting lots of colors
>>>> in the palette file, as it just confuses people :-)
>>>>
>>>> So forget our testing, we have only put the colors we use in
>>>> the mapfile once in the palette file(attached in the first
>>>> mail), and the error in the color is like on the map I
>>>> attached(first mail).
>>>>
>>>> Espen
>>>>
>>>>
>>>>
>>>> 2009/11/6 Thomas Bonfort <[hidden email]>:
>>>>> Stephen Woodbridge replied to this thread, and gave the
>>>>> correct usage of the palette file: set the same colors in
>>>>> your palette file as in your mapfile.
>>>>>
>>>>> regards,
>>>>>
>>>>> thomas
>>>>>
>>>>> www.camptocamp.com [phone]
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen
>>>>> <[hidden email]> wrote:
>>>>>> Justed wanted to bring this question into attention again
>>>>>> since we did not get a solution to the problem, and we have
>>>>>> not found one either.
>>>>>>
>>>>>> Could this possibly be a bug in Mapserver? Should we report
>>>>>> it?
>>>>>>
>>>>>> Espen
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>>>>> Hi!
>>>>>>>
>>>>>>> We are testing out using a palette file in our
>>>>>>> outputformat to decrease file size in the png output.
>>>>>>> Most of the time this works great, but some times when we
>>>>>>> are tiling the data we get some errors. The color seem to
>>>>>>> shift to a similar color from one tile to another.
>>>>>>>
>>>>>>> We have added the colors we use in the map file in the
>>>>>>> palette.txt file. The documentation says it needs 256
>>>>>>> colors in the map file, but we do not use that many
>>>>>>> colors right now. (we tried adding the same color more
>>>>>>> than one time, but that created other problems....)
>>>>>>>
>>>>>>> I have attached a png file showing the problem across a
>>>>>>> lake. The color on the right side is the correct color
>>>>>>> and the color we have added to the palette file. The
>>>>>>> color on the left side of the lake is not something we
>>>>>>> have set.
>>>>>>>
>>>>>>> I have also added the palette.txt file and the
>>>>>>> outputformat we use is this:
>>>>>>>
>>>>>>> OUTPUTFORMAT NAME             "png" DRIVER
>>>>>>> "AGG/PNG" MIMETYPE         "image/png" IMAGEMODE
>>>>>>> "rgb" EXTENSION        "png" FORMATOPTION
>>>>>>> "PALETTE_FORCE=TRUE" FORMATOPTION
>>>>>>> "PALETTE=/data/maps/palette.txt" END
>>>>>>>
>>>>>>> Does anybody know why this happens in Mapserver and how
>>>>>>> to fix it?
>>>>>>>
>>>>>>> Espen
>>>>>>>
>>>>>> _______________________________________________
>>>>>> mapserver-users mailing list
>>>>>> [hidden email]
>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>>
>>>> _______________________________________________ mapserver-users
>>>> mailing list [hidden email]
>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>
>> _______________________________________________ mapserver-users
>> mailing list [hidden email]
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Espen Isaksen]

Is this the only way to make it work correctly? It seems a lot easier
to extract all the RGB colors we use from the map file and add that to
the palette file? That is what we have done now, and it will be a lot
more work to actually extract the colors from all the different map
images we then have to create(different colors going from mountain
areas, forest areas down to urban areas).

Espen



2009/11/6 Steve Lime <[hidden email]>:

> Correct. My palette creation process has been to:
>
> 1) create a master image that shows as many possible rendering outputs as possible as a 24-bit PNG.
>
> 2) use a tool to reduce the colors in that image to the desired number and create a 8-bit file. In my case
> I use PhotoShop and produce a gif. Here's a link to the one I used for our rec. compass app but after
> color reduction to 128 colors.
>
>  http://maps.dnr.state.mn.us/compass/remove/compass_color_master.gif
>
> 3) extract a palette from the 8-bit image. I wrote a little perl script that processes gdalinfo output.
>
> 4) my outputformat block is like so:
>
>  OUTPUTFORMAT
>    NAME png
>    DRIVER "AGG/PNG"
>    MIMETYPE "image/png"
>    IMAGEMODE RGB
>    EXTENSION "png"
>    FORMATOPTION "INTERLACE=OFF"
>    FORMATOPTION "PALETTE_FORCE=TRUE"
>    FORMATOPTION "PALETTE=/mapserver/compass/compass.palette"
>  END
>
> I've not had problems with this method...
>
> It's possible there's a bug but it's going to be difficult to fix without a good test case.
>
> Steve
>
>>>> On 11/6/2009 at 9:52 AM, in message
> <[hidden email]>, Espen Isaksen
> <[hidden email]> wrote:
>> Sorry, this still creates trouble. And you have omitted
>>
>> FORMATOPTION   "PALETTE_FORCE=TRUE"
>>
>> on this one. That means it does not use the palette file right?
>>
>> Espen
>>
>>
>> 2009/11/6 Stephen Woodbridge <[hidden email]>:
>>> Espen,
>>>
>>> Try using this:
>>>
>>>    OUTPUTFORMAT
>>>        NAME agg
>>>        DRIVER "AGG/PNG"
>>>        MIMETYPE "image/png"
>>>        IMAGEMODE RGB
>>>        FORMATOPTION "INTERLACE=false"
>>>        FORMATOPTION "QUANTIZE_FORCE=ON"
>>>        FORMATOPTION "QUANTIZE_DITHER=OFF"
>>>        FORMATOPTION "QUANTIZE_COLORS=256"
>>>        FORMATOPTION "PALETTE=/data/maps/palette.txt"
>>>    END
>>>
>>> And see if it does what you want. Also note that I use "ON" and note "TRUE"
>>> as the value of "QUANTIZE_FORCE", but I'm not sure if the matters or not.
>>>
>>> -Steve
>>>
>>> Espen Isaksen wrote:
>>>>
>>>> Yes, that is what we have been doing all along. I guess I never should
>>>> have mentioned our testing with putting lots of colors in the palette
>>>> file, as it just confuses people :-)
>>>>
>>>> So forget our testing, we have only put the colors we use in the
>>>> mapfile once in the palette file(attached in the first mail), and the
>>>> error in the color is like on the map I attached(first mail).
>>>>
>>>> Espen
>>>>
>>>>
>>>>
>>>> 2009/11/6 Thomas Bonfort <[hidden email]>:
>>>>>
>>>>> Stephen Woodbridge replied to this thread, and gave the correct usage
>>>>> of the palette file: set the same colors in your palette file as in
>>>>> your mapfile.
>>>>>
>>>>> regards,
>>>>>
>>>>> thomas
>>>>>
>>>>> www.camptocamp.com
>>>>> [phone]
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]>
>>>>> wrote:
>>>>>>
>>>>>> Justed wanted to bring this question into attention again since we did
>>>>>> not get a solution to the problem, and we have not found one either.
>>>>>>
>>>>>> Could this possibly be a bug in Mapserver? Should we report it?
>>>>>>
>>>>>> Espen
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>>>>>
>>>>>>> Hi!
>>>>>>>
>>>>>>> We are testing out using a palette file in our outputformat to
>>>>>>> decrease file size in the png output. Most of the time this works
>>>>>>> great, but some times when we are tiling the data we get some errors.
>>>>>>> The color seem to shift to a similar color from one tile to another.
>>>>>>>
>>>>>>> We have added the colors we use in the map file in the palette.txt
>>>>>>> file. The documentation says it needs 256 colors in the map file, but
>>>>>>> we do not use that many colors right now. (we tried adding the same
>>>>>>> color more than one time, but that created other problems....)
>>>>>>>
>>>>>>> I have attached a png file showing the problem across a lake. The
>>>>>>> color on the right side is the correct color and the color we have
>>>>>>> added to the palette file. The color on the left side of the lake is
>>>>>>> not something we have set.
>>>>>>>
>>>>>>> I have also added the palette.txt file and the outputformat we use is
>>>>>>> this:
>>>>>>>
>>>>>>>        OUTPUTFORMAT
>>>>>>>                       NAME             "png"
>>>>>>>                       DRIVER           "AGG/PNG"
>>>>>>>                       MIMETYPE         "image/png"
>>>>>>>                       IMAGEMODE        "rgb"
>>>>>>>                       EXTENSION        "png"
>>>>>>>                       FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>>>>                       FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>>>>                END
>>>>>>>
>>>>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>>>>
>>>>>>> Espen
>>>>>>>
>>>>>> _______________________________________________
>>>>>> mapserver-users mailing list
>>>>>> [hidden email]
>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>>
>>>> _______________________________________________
>>>> mapserver-users mailing list
>>>> [hidden email]
>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>
>>>
>> _______________________________________________
>> mapserver-users mailing list
>> [hidden email]
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Stephen Woodbridge]

What you are doing is a "95%" solution. What you are actually missing is
that if you use images in symbols, that these are not covered by the
colors in the mapfile and it is possible that the colors on the symbols
may shift. If you do not see any issue with that then you are probably ok.

-Steve W

Espen Isaksen wrote:

> Is this the only way to make it work correctly? It seems a lot easier
> to extract all the RGB colors we use from the map file and add that to
> the palette file? That is what we have done now, and it will be a lot
> more work to actually extract the colors from all the different map
> images we then have to create(different colors going from mountain
> areas, forest areas down to urban areas).
>
> Espen
>
>
>
> 2009/11/6 Steve Lime <[hidden email]>:
>> Correct. My palette creation process has been to:
>>
>> 1) create a master image that shows as many possible rendering outputs as possible as a 24-bit PNG.
>>
>> 2) use a tool to reduce the colors in that image to the desired number and create a 8-bit file. In my case
>> I use PhotoShop and produce a gif. Here's a link to the one I used for our rec. compass app but after
>> color reduction to 128 colors.
>>
>>  http://maps.dnr.state.mn.us/compass/remove/compass_color_master.gif
>>
>> 3) extract a palette from the 8-bit image. I wrote a little perl script that processes gdalinfo output.
>>
>> 4) my outputformat block is like so:
>>
>>  OUTPUTFORMAT
>>    NAME png
>>    DRIVER "AGG/PNG"
>>    MIMETYPE "image/png"
>>    IMAGEMODE RGB
>>    EXTENSION "png"
>>    FORMATOPTION "INTERLACE=OFF"
>>    FORMATOPTION "PALETTE_FORCE=TRUE"
>>    FORMATOPTION "PALETTE=/mapserver/compass/compass.palette"
>>  END
>>
>> I've not had problems with this method...
>>
>> It's possible there's a bug but it's going to be difficult to fix without a good test case.
>>
>> Steve
>>
>>>>> On 11/6/2009 at 9:52 AM, in message
>> <[hidden email]>, Espen Isaksen
>> <[hidden email]> wrote:
>>> Sorry, this still creates trouble. And you have omitted
>>>
>>> FORMATOPTION   "PALETTE_FORCE=TRUE"
>>>
>>> on this one. That means it does not use the palette file right?
>>>
>>> Espen
>>>
>>>
>>> 2009/11/6 Stephen Woodbridge <[hidden email]>:
>>>> Espen,
>>>>
>>>> Try using this:
>>>>
>>>>    OUTPUTFORMAT
>>>>        NAME agg
>>>>        DRIVER "AGG/PNG"
>>>>        MIMETYPE "image/png"
>>>>        IMAGEMODE RGB
>>>>        FORMATOPTION "INTERLACE=false"
>>>>        FORMATOPTION "QUANTIZE_FORCE=ON"
>>>>        FORMATOPTION "QUANTIZE_DITHER=OFF"
>>>>        FORMATOPTION "QUANTIZE_COLORS=256"
>>>>        FORMATOPTION "PALETTE=/data/maps/palette.txt"
>>>>    END
>>>>
>>>> And see if it does what you want. Also note that I use "ON" and note "TRUE"
>>>> as the value of "QUANTIZE_FORCE", but I'm not sure if the matters or not.
>>>>
>>>> -Steve
>>>>
>>>> Espen Isaksen wrote:
>>>>> Yes, that is what we have been doing all along. I guess I never should
>>>>> have mentioned our testing with putting lots of colors in the palette
>>>>> file, as it just confuses people :-)
>>>>>
>>>>> So forget our testing, we have only put the colors we use in the
>>>>> mapfile once in the palette file(attached in the first mail), and the
>>>>> error in the color is like on the map I attached(first mail).
>>>>>
>>>>> Espen
>>>>>
>>>>>
>>>>>
>>>>> 2009/11/6 Thomas Bonfort <[hidden email]>:
>>>>>> Stephen Woodbridge replied to this thread, and gave the correct usage
>>>>>> of the palette file: set the same colors in your palette file as in
>>>>>> your mapfile.
>>>>>>
>>>>>> regards,
>>>>>>
>>>>>> thomas
>>>>>>
>>>>>> www.camptocamp.com
>>>>>> [phone]
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]>
>>>>>> wrote:
>>>>>>> Justed wanted to bring this question into attention again since we did
>>>>>>> not get a solution to the problem, and we have not found one either.
>>>>>>>
>>>>>>> Could this possibly be a bug in Mapserver? Should we report it?
>>>>>>>
>>>>>>> Espen
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>>>>>> Hi!
>>>>>>>>
>>>>>>>> We are testing out using a palette file in our outputformat to
>>>>>>>> decrease file size in the png output. Most of the time this works
>>>>>>>> great, but some times when we are tiling the data we get some errors.
>>>>>>>> The color seem to shift to a similar color from one tile to another.
>>>>>>>>
>>>>>>>> We have added the colors we use in the map file in the palette.txt
>>>>>>>> file. The documentation says it needs 256 colors in the map file, but
>>>>>>>> we do not use that many colors right now. (we tried adding the same
>>>>>>>> color more than one time, but that created other problems....)
>>>>>>>>
>>>>>>>> I have attached a png file showing the problem across a lake. The
>>>>>>>> color on the right side is the correct color and the color we have
>>>>>>>> added to the palette file. The color on the left side of the lake is
>>>>>>>> not something we have set.
>>>>>>>>
>>>>>>>> I have also added the palette.txt file and the outputformat we use is
>>>>>>>> this:
>>>>>>>>
>>>>>>>>        OUTPUTFORMAT
>>>>>>>>                       NAME             "png"
>>>>>>>>                       DRIVER           "AGG/PNG"
>>>>>>>>                       MIMETYPE         "image/png"
>>>>>>>>                       IMAGEMODE        "rgb"
>>>>>>>>                       EXTENSION        "png"
>>>>>>>>                       FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>>>>>                       FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>>>>>                END
>>>>>>>>
>>>>>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>>>>>
>>>>>>>> Espen
>>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> mapserver-users mailing list
>>>>>>> [hidden email]
>>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>>>
>>>>> _______________________________________________
>>>>> mapserver-users mailing list
>>>>> [hidden email]
>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>
>>> _______________________________________________
>>> mapserver-users mailing list
>>> [hidden email]
>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Thomas Bonfort-2]

Espen,
please provide the complete mapfile and actual palette file that were
used for the images you produced.
looking at the code there's no reason another color should be picked
if it was provided in the palette file, so either you're doing
something wrong in your mapfile/palette combination, either there's a
bug in the code somewhere.

thomas
www.camptocamp.com
[phone]



On Sat, Nov 7, 2009 at 11:48, Espen Isaksen <[hidden email]> wrote:

> Is this the only way to make it work correctly? It seems a lot easier
> to extract all the RGB colors we use from the map file and add that to
> the palette file? That is what we have done now, and it will be a lot
> more work to actually extract the colors from all the different map
> images we then have to create(different colors going from mountain
> areas, forest areas down to urban areas).
>
> Espen
>
>
>
> 2009/11/6 Steve Lime <[hidden email]>:
>> Correct. My palette creation process has been to:
>>
>> 1) create a master image that shows as many possible rendering outputs as possible as a 24-bit PNG.
>>
>> 2) use a tool to reduce the colors in that image to the desired number and create a 8-bit file. In my case
>> I use PhotoShop and produce a gif. Here's a link to the one I used for our rec. compass app but after
>> color reduction to 128 colors.
>>
>>  http://maps.dnr.state.mn.us/compass/remove/compass_color_master.gif
>>
>> 3) extract a palette from the 8-bit image. I wrote a little perl script that processes gdalinfo output.
>>
>> 4) my outputformat block is like so:
>>
>>  OUTPUTFORMAT
>>    NAME png
>>    DRIVER "AGG/PNG"
>>    MIMETYPE "image/png"
>>    IMAGEMODE RGB
>>    EXTENSION "png"
>>    FORMATOPTION "INTERLACE=OFF"
>>    FORMATOPTION "PALETTE_FORCE=TRUE"
>>    FORMATOPTION "PALETTE=/mapserver/compass/compass.palette"
>>  END
>>
>> I've not had problems with this method...
>>
>> It's possible there's a bug but it's going to be difficult to fix without a good test case.
>>
>> Steve
>>
>>>>> On 11/6/2009 at 9:52 AM, in message
>> <[hidden email]>, Espen Isaksen
>> <[hidden email]> wrote:
>>> Sorry, this still creates trouble. And you have omitted
>>>
>>> FORMATOPTION   "PALETTE_FORCE=TRUE"
>>>
>>> on this one. That means it does not use the palette file right?
>>>
>>> Espen
>>>
>>>
>>> 2009/11/6 Stephen Woodbridge <[hidden email]>:
>>>> Espen,
>>>>
>>>> Try using this:
>>>>
>>>>    OUTPUTFORMAT
>>>>        NAME agg
>>>>        DRIVER "AGG/PNG"
>>>>        MIMETYPE "image/png"
>>>>        IMAGEMODE RGB
>>>>        FORMATOPTION "INTERLACE=false"
>>>>        FORMATOPTION "QUANTIZE_FORCE=ON"
>>>>        FORMATOPTION "QUANTIZE_DITHER=OFF"
>>>>        FORMATOPTION "QUANTIZE_COLORS=256"
>>>>        FORMATOPTION "PALETTE=/data/maps/palette.txt"
>>>>    END
>>>>
>>>> And see if it does what you want. Also note that I use "ON" and note "TRUE"
>>>> as the value of "QUANTIZE_FORCE", but I'm not sure if the matters or not.
>>>>
>>>> -Steve
>>>>
>>>> Espen Isaksen wrote:
>>>>>
>>>>> Yes, that is what we have been doing all along. I guess I never should
>>>>> have mentioned our testing with putting lots of colors in the palette
>>>>> file, as it just confuses people :-)
>>>>>
>>>>> So forget our testing, we have only put the colors we use in the
>>>>> mapfile once in the palette file(attached in the first mail), and the
>>>>> error in the color is like on the map I attached(first mail).
>>>>>
>>>>> Espen
>>>>>
>>>>>
>>>>>
>>>>> 2009/11/6 Thomas Bonfort <[hidden email]>:
>>>>>>
>>>>>> Stephen Woodbridge replied to this thread, and gave the correct usage
>>>>>> of the palette file: set the same colors in your palette file as in
>>>>>> your mapfile.
>>>>>>
>>>>>> regards,
>>>>>>
>>>>>> thomas
>>>>>>
>>>>>> www.camptocamp.com
>>>>>> [phone]
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]>
>>>>>> wrote:
>>>>>>>
>>>>>>> Justed wanted to bring this question into attention again since we did
>>>>>>> not get a solution to the problem, and we have not found one either.
>>>>>>>
>>>>>>> Could this possibly be a bug in Mapserver? Should we report it?
>>>>>>>
>>>>>>> Espen
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>>>>>>
>>>>>>>> Hi!
>>>>>>>>
>>>>>>>> We are testing out using a palette file in our outputformat to
>>>>>>>> decrease file size in the png output. Most of the time this works
>>>>>>>> great, but some times when we are tiling the data we get some errors.
>>>>>>>> The color seem to shift to a similar color from one tile to another.
>>>>>>>>
>>>>>>>> We have added the colors we use in the map file in the palette.txt
>>>>>>>> file. The documentation says it needs 256 colors in the map file, but
>>>>>>>> we do not use that many colors right now. (we tried adding the same
>>>>>>>> color more than one time, but that created other problems....)
>>>>>>>>
>>>>>>>> I have attached a png file showing the problem across a lake. The
>>>>>>>> color on the right side is the correct color and the color we have
>>>>>>>> added to the palette file. The color on the left side of the lake is
>>>>>>>> not something we have set.
>>>>>>>>
>>>>>>>> I have also added the palette.txt file and the outputformat we use is
>>>>>>>> this:
>>>>>>>>
>>>>>>>>        OUTPUTFORMAT
>>>>>>>>                       NAME             "png"
>>>>>>>>                       DRIVER           "AGG/PNG"
>>>>>>>>                       MIMETYPE         "image/png"
>>>>>>>>                       IMAGEMODE        "rgb"
>>>>>>>>                       EXTENSION        "png"
>>>>>>>>                       FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>>>>>                       FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>>>>>                END
>>>>>>>>
>>>>>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>>>>>
>>>>>>>> Espen
>>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> mapserver-users mailing list
>>>>>>> [hidden email]
>>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>>>
>>>>> _______________________________________________
>>>>> mapserver-users mailing list
>>>>> [hidden email]
>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>
>>>>
>>> _______________________________________________
>>> mapserver-users mailing list
>>> [hidden email]
>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>
> _______________________________________________
> mapserver-users mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>

_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[Espen Isaksen]

Hi again!

The mapfile we are using is about 10 000 lines of code so I have not
attached that file. I can send the map file privatly, but I rather not
put it on the mailing list.  However, I have added the main map file,
the palette file and the output format file.

Espen



2009/11/7 Thomas Bonfort <[hidden email]>:

> Espen,
> please provide the complete mapfile and actual palette file that were
> used for the images you produced.
> looking at the code there's no reason another color should be picked
> if it was provided in the palette file, so either you're doing
> something wrong in your mapfile/palette combination, either there's a
> bug in the code somewhere.
>
> thomas
> www.camptocamp.com
> [phone]
>
>
>
> On Sat, Nov 7, 2009 at 11:48, Espen Isaksen <[hidden email]> wrote:
>> Is this the only way to make it work correctly? It seems a lot easier
>> to extract all the RGB colors we use from the map file and add that to
>> the palette file? That is what we have done now, and it will be a lot
>> more work to actually extract the colors from all the different map
>> images we then have to create(different colors going from mountain
>> areas, forest areas down to urban areas).
>>
>> Espen
>>
>>
>>
>> 2009/11/6 Steve Lime <[hidden email]>:
>>> Correct. My palette creation process has been to:
>>>
>>> 1) create a master image that shows as many possible rendering outputs as possible as a 24-bit PNG.
>>>
>>> 2) use a tool to reduce the colors in that image to the desired number and create a 8-bit file. In my case
>>> I use PhotoShop and produce a gif. Here's a link to the one I used for our rec. compass app but after
>>> color reduction to 128 colors.
>>>
>>>  http://maps.dnr.state.mn.us/compass/remove/compass_color_master.gif
>>>
>>> 3) extract a palette from the 8-bit image. I wrote a little perl script that processes gdalinfo output.
>>>
>>> 4) my outputformat block is like so:
>>>
>>>  OUTPUTFORMAT
>>>    NAME png
>>>    DRIVER "AGG/PNG"
>>>    MIMETYPE "image/png"
>>>    IMAGEMODE RGB
>>>    EXTENSION "png"
>>>    FORMATOPTION "INTERLACE=OFF"
>>>    FORMATOPTION "PALETTE_FORCE=TRUE"
>>>    FORMATOPTION "PALETTE=/mapserver/compass/compass.palette"
>>>  END
>>>
>>> I've not had problems with this method...
>>>
>>> It's possible there's a bug but it's going to be difficult to fix without a good test case.
>>>
>>> Steve
>>>
>>>>>> On 11/6/2009 at 9:52 AM, in message
>>> <[hidden email]>, Espen Isaksen
>>> <[hidden email]> wrote:
>>>> Sorry, this still creates trouble. And you have omitted
>>>>
>>>> FORMATOPTION   "PALETTE_FORCE=TRUE"
>>>>
>>>> on this one. That means it does not use the palette file right?
>>>>
>>>> Espen
>>>>
>>>>
>>>> 2009/11/6 Stephen Woodbridge <[hidden email]>:
>>>>> Espen,
>>>>>
>>>>> Try using this:
>>>>>
>>>>>    OUTPUTFORMAT
>>>>>        NAME agg
>>>>>        DRIVER "AGG/PNG"
>>>>>        MIMETYPE "image/png"
>>>>>        IMAGEMODE RGB
>>>>>        FORMATOPTION "INTERLACE=false"
>>>>>        FORMATOPTION "QUANTIZE_FORCE=ON"
>>>>>        FORMATOPTION "QUANTIZE_DITHER=OFF"
>>>>>        FORMATOPTION "QUANTIZE_COLORS=256"
>>>>>        FORMATOPTION "PALETTE=/data/maps/palette.txt"
>>>>>    END
>>>>>
>>>>> And see if it does what you want. Also note that I use "ON" and note "TRUE"
>>>>> as the value of "QUANTIZE_FORCE", but I'm not sure if the matters or not.
>>>>>
>>>>> -Steve
>>>>>
>>>>> Espen Isaksen wrote:
>>>>>>
>>>>>> Yes, that is what we have been doing all along. I guess I never should
>>>>>> have mentioned our testing with putting lots of colors in the palette
>>>>>> file, as it just confuses people :-)
>>>>>>
>>>>>> So forget our testing, we have only put the colors we use in the
>>>>>> mapfile once in the palette file(attached in the first mail), and the
>>>>>> error in the color is like on the map I attached(first mail).
>>>>>>
>>>>>> Espen
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2009/11/6 Thomas Bonfort <[hidden email]>:
>>>>>>>
>>>>>>> Stephen Woodbridge replied to this thread, and gave the correct usage
>>>>>>> of the palette file: set the same colors in your palette file as in
>>>>>>> your mapfile.
>>>>>>>
>>>>>>> regards,
>>>>>>>
>>>>>>> thomas
>>>>>>>
>>>>>>> www.camptocamp.com
>>>>>>> [phone]
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Nov 6, 2009 at 14:24, Espen Isaksen <[hidden email]>
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> Justed wanted to bring this question into attention again since we did
>>>>>>>> not get a solution to the problem, and we have not found one either.
>>>>>>>>
>>>>>>>> Could this possibly be a bug in Mapserver? Should we report it?
>>>>>>>>
>>>>>>>> Espen
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> 2009/10/28 Espen Isaksen <[hidden email]>:
>>>>>>>>>
>>>>>>>>> Hi!
>>>>>>>>>
>>>>>>>>> We are testing out using a palette file in our outputformat to
>>>>>>>>> decrease file size in the png output. Most of the time this works
>>>>>>>>> great, but some times when we are tiling the data we get some errors.
>>>>>>>>> The color seem to shift to a similar color from one tile to another.
>>>>>>>>>
>>>>>>>>> We have added the colors we use in the map file in the palette.txt
>>>>>>>>> file. The documentation says it needs 256 colors in the map file, but
>>>>>>>>> we do not use that many colors right now. (we tried adding the same
>>>>>>>>> color more than one time, but that created other problems....)
>>>>>>>>>
>>>>>>>>> I have attached a png file showing the problem across a lake. The
>>>>>>>>> color on the right side is the correct color and the color we have
>>>>>>>>> added to the palette file. The color on the left side of the lake is
>>>>>>>>> not something we have set.
>>>>>>>>>
>>>>>>>>> I have also added the palette.txt file and the outputformat we use is
>>>>>>>>> this:
>>>>>>>>>
>>>>>>>>>        OUTPUTFORMAT
>>>>>>>>>                       NAME             "png"
>>>>>>>>>                       DRIVER           "AGG/PNG"
>>>>>>>>>                       MIMETYPE         "image/png"
>>>>>>>>>                       IMAGEMODE        "rgb"
>>>>>>>>>                       EXTENSION        "png"
>>>>>>>>>                       FORMATOPTION     "PALETTE_FORCE=TRUE"
>>>>>>>>>                       FORMATOPTION     "PALETTE=/data/maps/palette.txt"
>>>>>>>>>                END
>>>>>>>>>
>>>>>>>>> Does anybody know why this happens in Mapserver and how to fix it?
>>>>>>>>>
>>>>>>>>> Espen
>>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> mapserver-users mailing list
>>>>>>>> [hidden email]
>>>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>>>>
>>>>>> _______________________________________________
>>>>>> mapserver-users mailing list
>>>>>> [hidden email]
>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>
>>>>>
>>>> _______________________________________________
>>>> mapserver-users mailing list
>>>> [hidden email]
>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>
>> _______________________________________________
>> mapserver-users mailing list
>> [hidden email]
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>
>

0,0,0
0,0,224
0,0,255
0,153,0
0,208,104
100,100,100
100,100,255
10,10,10
102,102,102
102,51,51
105,105,105
108,189,243
108,190,232
109,187,239
110,110,110
115,117,208
119,215,81
123,123,123
128,0,128
130,130,130
135,151,115
140,140,140
144,108,0
144,238,144
150,150,150
150,80,0
152,251,152
153,102,0
153,102,102
153,102,51
153,153,153
153,204,102
153,204,255
153,255,255
160,160,160
175,175,175
176,78,239
177,177,168
178,157,30
180,156,30
180,180,180
1,80,195
182,231,182
184,255,166
187,187,187
190,190,170
192,192,0
194,255,166
196,255,188
200,200,145
200,200,200
20,20,141
20,20,20
202,193,176
204,102,153
204,153,102
204,84,39
210,150,60
210,180,140
211,211,211
215,215,215
216,245,203
217,64,51
219,219,183
220,220,200
220,220,220
223,217,197
230,230,230
230,234,80
231,232,24
235,163,89
235,235,235
240,240,240
244,213,66
246,246,77
246,252,195
248,248,201
250,250,250
25,25,25
253,163,30
25,32,24
253,240,196
255,0,0
255,0,255
255,144,0
255,153,204
255,165,0
255,231,208
255,246,77
255,255,102
255,255,204
255,255,255
255,255,51
255,255,68
255,255,69
25,69,125
30,30,30
50,50,50
51,102,204
51,153,0
51,153,102
51,153,255
57,105,141
60,60,60
73,101,54
74,164,22
79,162,68
80,120,220
80,80,80
84,86,220
87,118,69
90,40,30
98,98,93



_______________________________________________
mapserver-users mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapserver-users