Harvesting CSW

12 messages Options
Embed this post
Permalink
Sarah_S

Harvesting CSW

Reply Threaded More More options
Print post
Permalink
Hi all,

I want to harvets from csw nodes (server).
So I use the harvesting management and add these URLS (after selecting the right type;-)):
http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities (from there:link of another thread
and
http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
but both send me error. If I type these urls in my browser (firefox) I get a respond.
First one said UnknownHostException and second NoRouteToHostException.

I think I did domething wrong because of not understanding harvesting, csw correctly.
Can anybody perhaps explain me some important things? It would be very appreciated!

I read the manual (so I know now that harvestes metadata could not be changed ;-)) but did not find a solution for my problem.

Thanks.
best regards
Sarah
Sarah_S

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
sorry,
here are the stack trace:
noroutetohost:
2009-10-15 13:31:28,137 DEBUG [jeeves.service] - Service xml is :
<nodes>
  <node id="192" type="csw">
    <site>
      <name>test</name>
      <uuid>1e21b53f-46df-4dde-b9ad-e68d0b02fb14</uuid>
      <account>
        <use>false</use>
        <username />
        <password />
      </account>
      <capabilitiesUrl>http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2</capabilitiesUrl>
      <icon>default.gif</icon>
    </site>
    <options>
      <every>30</every>
      <oneRunOnly>false</oneRunOnly>
      <status>active</status>
    </options>
    <searches />
    <categories>
      <category id="1" />
    </categories>
    <info>
      <lastRun />
      <running>false</running>
    </info>
    <error id="error">
      <message>No route to host: connect</message>
      <class>NoRouteToHostException</class>
      <stack>
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="-2" method="socketConnect" />
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="333" method="doConnect" />
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="195" method="connectToAddress" />
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="182" method="connect" />
        <at class="java.net.SocksSocketImpl" file="SocksSocketImpl.java" line="366" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="525" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="475" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="372" method="<init>" />
        <at class="java.net.Socket" file="Socket.java" line="246" method="<init>" />
        <at class="org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory" file="DefaultProtocolSocketFactory.java" line="79" method="createSocket" />
      </stack>
    </error>
  </node>
</nodes>
2009-10-15 13:31:28,137 INFO  [jeeves.service] -    -> output ended for : xml.harvesting.get
2009-10-15 13:31:28,137 INFO  [jeeves.service] -  -> dispatch ended for : xml.harvesting.get
2009-10-15 13:31:28,028 INFO  [jeeves.service] -      -> writing xml for : xml.harvesting.info

UnknownHostException:
2009-10-15 15:15:34,921 DEBUG [jeeves.service] - Service xml is :
<nodes>
  <node id="192" type="csw">
    <site>
      <name>test</name>
      <uuid>1e21b53f-46df-4dde-b9ad-e68d0b02fb14</uuid>
      <account>
        <use>false</use>
        <username />
        <password />
      </account>
      <capabilitiesUrl>http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2</capabilitiesUrl>
      <icon>csw.gif</icon>
    </site>
    <options>
      <every>30</every>
      <oneRunOnly>false</oneRunOnly>
      <status>active</status>
    </options>
    <searches />
    <categories>
      <category id="1" />
    </categories>
    <info>
      <lastRun />
      <running>false</running>
    </info>
    <error id="error">
      <message>No route to host: connect</message>
      <class>NoRouteToHostException</class>
      <stack>
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="-2" method="socketConnect" />
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="333" method="doConnect" />
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="195" method="connectToAddress" />
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="182" method="connect" />
        <at class="java.net.SocksSocketImpl" file="SocksSocketImpl.java" line="366" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="525" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="475" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="372" method="<init>" />
        <at class="java.net.Socket" file="Socket.java" line="246" method="<init>" />
        <at class="org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory" file="DefaultProtocolSocketFactory.java" line="79" method="createSocket" />
      </stack>
    </error>
  </node>
  <node id="244" type="csw">
    <site>
      <name>test</name>
      <uuid>7a6da52c-5d66-48a5-9e57-daaa816c8ab0</uuid>
      <account>
        <use>false</use>
        <username />
        <password />
      </account>
      <capabilitiesUrl>http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities</capabilitiesUrl>
      <icon>csw.gif</icon>
    </site>
    <options>
      <every>30</every>
      <oneRunOnly>false</oneRunOnly>
      <status>active</status>
    </options>
    <searches />
    <categories>
      <category id="1" />
    </categories>
    <info>
      <lastRun />
      <running>false</running>
    </info>
    <error id="error">
      <message>sandre.eaufrance.fr</message>
      <class>UnknownHostException</class>
      <stack>
        <at class="java.net.PlainSocketImpl" file="PlainSocketImpl.java" line="177" method="connect" />
        <at class="java.net.SocksSocketImpl" file="SocksSocketImpl.java" line="366" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="525" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="475" method="connect" />
        <at class="java.net.Socket" file="Socket.java" line="372" method="<init>" />
        <at class="java.net.Socket" file="Socket.java" line="246" method="<init>" />
        <at class="org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory" file="DefaultProtocolSocketFactory.java" line="79" method="createSocket" />
        <at class="org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory" file="DefaultProtocolSocketFactory.java" line="121" method="createSocket" />
        <at class="org.apache.commons.httpclient.HttpConnection" file="HttpConnection.java" line="706" method="open" />
        <at class="org.apache.commons.httpclient.HttpMethodDirector" file="HttpMethodDirector.java" line="386" method="executeWithRetry" />
      </stack>
    </error>
  </node>
</nodes>
2009-10-15 15:15:34,921 INFO  [jeeves.service] -    -> output ended for : xml.harvesting.get
2009-10-15 15:15:34,921 INFO  [jeeves.service] -  -> dispatch ended for : xml.harvesting.get

Thanks!



Sarah_S wrote:
Hi all,

I want to harvets from csw nodes (server).
So I use the harvesting management and add these URLS (after selecting the right type;-)):
http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities (from there:link of another thread
and
http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
but both send me error. If I type these urls in my browser (firefox) I get a respond.
First one said UnknownHostException and second NoRouteToHostException.

I think I did domething wrong because of not understanding harvesting, csw correctly.
Can anybody perhaps explain me some important things? It would be very appreciated!

I read the manual (so I know now that harvestes metadata could not be changed ;-)) but did not find a solution for my problem.

Thanks.
best regards
Sarah
wgrunberg

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
In reply to this post by Sarah_S
Dear Sarah,

Sorry, our CSW development service
(http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
is not working properly because of a bug with deegree_csw 1.3pre.
Deegree's CSW server returns some bogus elements
(http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
which will be fixed with the next release.

Ciao, Wolfgang

_______________________________
Wolfgang Grunberg
Arizona Geological Survey
[hidden email]
520-770-3500




Sarah_S wrote:

> Hi all,
>
> I want to harvets from csw nodes (server).
> So I use the harvesting management and add these URLS (after selecting the
> right type;-)):
> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
> (from there:
> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
> link of another thread
> and
> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
> but both send me error. If I type these urls in my browser (firefox) I get a
> respond.
> First one said UnknownHostException and second NoRouteToHostException.
>
> I think I did domething wrong because of not understanding harvesting, csw
> correctly.
> Can anybody perhaps explain me some important things? It would be very
> appreciated!
>
> I read the manual (so I know now that harvestes metadata could not be
> changed ;-)) but did not find a solution for my problem.
>
> Thanks.
> best regards
> Sarah
>
>  

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Sarah_S

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
Thank you Wolfgang for information.

I tried it with other services/URL´s but none worked. That´s why I suppose that I´m doing something wrong. So my procedure:
I looged in with admin, went to harvesting management, click on add, choose Web Catalogue for the Web 2.0 and in next editor I enter my URL, Name for this csw, no user and password, choose a group ("sample group") and a register. I don´t believe that I need user and password do I?

Any further ideas?
Thanks.

best regards
Sarah

wgrunberg wrote:
Dear Sarah,

Sorry, our CSW development service
(http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
is not working properly because of a bug with deegree_csw 1.3pre.
Deegree's CSW server returns some bogus elements
(http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
which will be fixed with the next release.

Ciao, Wolfgang

_______________________________
Wolfgang Grunberg
Arizona Geological Survey
wgrunberg@azgs.az.gov
520-770-3500




Sarah_S wrote:
> Hi all,
>
> I want to harvets from csw nodes (server).
> So I use the harvesting management and add these URLS (after selecting the
> right type;-)):
> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
> (from there:
> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
> link of another thread
> and
> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
> but both send me error. If I type these urls in my browser (firefox) I get a
> respond.
> First one said UnknownHostException and second NoRouteToHostException.
>
> I think I did domething wrong because of not understanding harvesting, csw
> correctly.
> Can anybody perhaps explain me some important things? It would be very
> appreciated!
>
> I read the manual (so I know now that harvestes metadata could not be
> changed ;-)) but did not find a solution for my problem.
>
> Thanks.
> best regards
> Sarah
>
>  

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Sarah_S

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
I did not solve this problem yet. Can anybody give me a hint or something else?
Am I right that Geonetwork 2.4 only support CSW 2.0.1 and 2.0.2 (and not 2.0.0)?

Thanks!
best regards
Sarah

Sarah_S wrote:
Thank you Wolfgang for information.

I tried it with other services/URL´s but none worked. That´s why I suppose that I´m doing something wrong. So my procedure:
I looged in with admin, went to harvesting management, click on add, choose Web Catalogue for the Web 2.0 and in next editor I enter my URL, Name for this csw, no user and password, choose a group ("sample group") and a register. I don´t believe that I need user and password do I?

Any further ideas?
Thanks.

best regards
Sarah

wgrunberg wrote:
Dear Sarah,

Sorry, our CSW development service
(http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
is not working properly because of a bug with deegree_csw 1.3pre.
Deegree's CSW server returns some bogus elements
(http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
which will be fixed with the next release.

Ciao, Wolfgang

_______________________________
Wolfgang Grunberg
Arizona Geological Survey
wgrunberg@azgs.az.gov
520-770-3500




Sarah_S wrote:
> Hi all,
>
> I want to harvets from csw nodes (server).
> So I use the harvesting management and add these URLS (after selecting the
> right type;-)):
> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
> (from there:
> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
> link of another thread
> and
> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
> but both send me error. If I type these urls in my browser (firefox) I get a
> respond.
> First one said UnknownHostException and second NoRouteToHostException.
>
> I think I did domething wrong because of not understanding harvesting, csw
> correctly.
> Can anybody perhaps explain me some important things? It would be very
> appreciated!
>
> I read the manual (so I know now that harvestes metadata could not be
> changed ;-)) but did not find a solution for my problem.
>
> Thanks.
> best regards
> Sarah
>
>  

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Sarah_S

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
Still having problems with harvesting management after trying for some weeks.
So I get some other errors which I don`t know if it is a geonetwork problem or a intranet/system problem.
We use a proxy with a PAC-File (which I specify at system configuration). Do we need to use Apache http or something for proxy?
I tried serveral harvesting with csw server and wms but none worked.
I get this strange stacktrace-popup (see picture) - is it right behavior?
So I get an "OperationAbortedEx: raised exception when searching. NullpointerException" in most cases (with this url e.g. http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2 ) or "OperationAborted: GetRecords operation not found" with this url: http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW. I can reach and get respond via webbrowser so the urls are valid.
Any hints are appreciated.

Thanks.

best regards
Sarah
gn_harvest
geonetwork_harvest 


Sarah_S wrote:
Thank you Wolfgang for information.

I tried it with other services/URL´s but none worked. That´s why I suppose that I´m doing something wrong. So my procedure:
I looged in with admin, went to harvesting management, click on add, choose Web Catalogue for the Web 2.0 and in next editor I enter my URL, Name for this csw, no user and password, choose a group ("sample group") and a register. I don´t believe that I need user and password do I?

Any further ideas?
Thanks.

best regards
Sarah

wgrunberg wrote:
Dear Sarah,

Sorry, our CSW development service
(http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
is not working properly because of a bug with deegree_csw 1.3pre.
Deegree's CSW server returns some bogus elements
(http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
which will be fixed with the next release.

Ciao, Wolfgang

_______________________________
Wolfgang Grunberg
Arizona Geological Survey
wgrunberg@azgs.az.gov
520-770-3500




Sarah_S wrote:
> Hi all,
>
> I want to harvets from csw nodes (server).
> So I use the harvesting management and add these URLS (after selecting the
> right type;-)):
> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
> (from there:
> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
> link of another thread
> and
> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
> but both send me error. If I type these urls in my browser (firefox) I get a
> respond.
> First one said UnknownHostException and second NoRouteToHostException.
>
> I think I did domething wrong because of not understanding harvesting, csw
> correctly.
> Can anybody perhaps explain me some important things? It would be very
> appreciated!
>
> I read the manual (so I know now that harvestes metadata could not be
> changed ;-)) but did not find a solution for my problem.
>
> Thanks.
> best regards
> Sarah
>
>  

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

doug_nebert

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
Sarah_S wrote:
> Still having problems with harvesting management after trying for some weeks.
> So I get some other errors which I don`t know if it is a geonetwork problem
> or a intranet/system problem.

I have installed GeoNetwork 2.4.2 in Linux and Windows and have been
able to perform a successful CSW harvest to several attempted (and
well-behaving) CSW targets, including the other GN instance CSW server!
Like you, I get the same NullPointerException error. I have initiated a
bug report in the http://trac.osgeo.org/geonetwork/ system.

This is definitely a bug - does anyone have success with CSW 2.0.2
harvest in GN 2.4.2?

Doug.

> We use a proxy with a PAC-File (which I specify at system configuration). Do
> we need to use Apache http or something for proxy?
> I tried serveral harvesting with csw server and wms but none worked.
> I get this strange stacktrace-popup (see picture) - is it right behavior?
> So I get an "OperationAbortedEx: raised exception when searching.
> NullpointerException" in most cases (with this url e.g.
> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2
> ) or "OperationAborted: GetRecords operation not found" with this url:
> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.
> I can reach and get respond via webbrowser so the urls are valid.
> Any hints are appreciated.
>
> Thanks.
>
> best regards
> Sarah
> http://n2.nabble.com/file/n3904733/gn_harvest2.jpg 
> http://n2.nabble.com/file/n3904733/geonetwork_harvest.jpg 
>
>
>
> Sarah_S wrote:
>> Thank you Wolfgang for information.
>>
>> I tried it with other services/URL´s but none worked. That´s why I suppose
>> that I´m doing something wrong. So my procedure:
>> I looged in with admin, went to harvesting management, click on add,
>> choose Web Catalogue for the Web 2.0 and in next editor I enter my URL,
>> Name for this csw, no user and password, choose a group ("sample group")
>> and a register. I don´t believe that I need user and password do I?
>>
>> Any further ideas?
>> Thanks.
>>
>> best regards
>> Sarah
>>
>>
>> wgrunberg wrote:
>>> Dear Sarah,
>>>
>>> Sorry, our CSW development service
>>> (http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
>>> is not working properly because of a bug with deegree_csw 1.3pre.
>>> Deegree's CSW server returns some bogus elements
>>> (http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
>>> which will be fixed with the next release.
>>>
>>> Ciao, Wolfgang
>>>
>>> _______________________________
>>> Wolfgang Grunberg
>>> Arizona Geological Survey
>>> [hidden email]
>>> 520-770-3500
>>>
>>>
>>>
>>>
>>> Sarah_S wrote:
>>>> Hi all,
>>>>
>>>> I want to harvets from csw nodes (server).
>>>> So I use the harvesting management and add these URLS (after selecting
>>>> the
>>>> right type;-)):
>>>> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
>>>> (from there:
>>>> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
>>>> link of another thread
>>>> and
>>>> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
>>>> but both send me error. If I type these urls in my browser (firefox) I
>>>> get a
>>>> respond.
>>>> First one said UnknownHostException and second NoRouteToHostException.
>>>>
>>>> I think I did domething wrong because of not understanding harvesting,
>>>> csw
>>>> correctly.
>>>> Can anybody perhaps explain me some important things? It would be very
>>>> appreciated!
>>>>
>>>> I read the manual (so I know now that harvestes metadata could not be
>>>> changed ;-)) but did not find a solution for my problem.
>>>>
>>>> Thanks.
>>>> best regards
>>>> Sarah
>>>>
>>>>  
>>> ------------------------------------------------------------------------------
>>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>>> is the only developer event you need to attend this year. Jumpstart your
>>> developing skills, take BlackBerry mobile applications to market and stay
>>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>>> http://p.sf.net/sfu/devconference
>>> _______________________________________________
>>> GeoNetwork-users mailing list
>>> [hidden email]
>>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>> GeoNetwork OpenSource is maintained at
>>> http://sourceforge.net/projects/geonetwork
>>>
>>>
>>
>
>
>


--
Douglas D. Nebert
Senior Advisor for Geospatial Technology, System-of-Systems Architect
FGDC Secretariat   T:703 648 4151    F:703 648-5755    C:703 459-5860


------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
doug_nebert

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
In reply to this post by Sarah_S
Sarah_S wrote:
> Still having problems with harvesting management after trying for some weeks.
> So I get some other errors which I don`t know if it is a geonetwork problem
> or a intranet/system problem.

I have installed GeoNetwork 2.4.2 in Linux and Windows and have been
UNABLE to perform a successful CSW harvest to several attempted (and
well-behaving) CSW targets, including the other GN instance CSW server!
Like you, I get the same NullPointerException error. I have initiated a
bug report in the http://trac.osgeo.org/geonetwork/ system.

This is definitely a bug - does anyone have success with CSW 2.0.2
harvest in GN 2.4.2?

Doug.

> We use a proxy with a PAC-File (which I specify at system configuration). Do
> we need to use Apache http or something for proxy?
> I tried serveral harvesting with csw server and wms but none worked.
> I get this strange stacktrace-popup (see picture) - is it right behavior?
> So I get an "OperationAbortedEx: raised exception when searching.
> NullpointerException" in most cases (with this url e.g.
> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2
> ) or "OperationAborted: GetRecords operation not found" with this url:
> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.
> I can reach and get respond via webbrowser so the urls are valid.
> Any hints are appreciated.
>
> Thanks.
>
> best regards
> Sarah
> http://n2.nabble.com/file/n3904733/gn_harvest2.jpg 
> http://n2.nabble.com/file/n3904733/geonetwork_harvest.jpg 
>
>
>
> Sarah_S wrote:
>> Thank you Wolfgang for information.
>>
>> I tried it with other services/URL´s but none worked. That´s why I suppose
>> that I´m doing something wrong. So my procedure:
>> I looged in with admin, went to harvesting management, click on add,
>> choose Web Catalogue for the Web 2.0 and in next editor I enter my URL,
>> Name for this csw, no user and password, choose a group ("sample group")
>> and a register. I don´t believe that I need user and password do I?
>>
>> Any further ideas?
>> Thanks.
>>
>> best regards
>> Sarah
>>
>>
>> wgrunberg wrote:
>>> Dear Sarah,
>>>
>>> Sorry, our CSW development service
>>> (http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
>>> is not working properly because of a bug with deegree_csw 1.3pre.
>>> Deegree's CSW server returns some bogus elements
>>> (http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
>>> which will be fixed with the next release.
>>>
>>> Ciao, Wolfgang
>>>
>>> _______________________________
>>> Wolfgang Grunberg
>>> Arizona Geological Survey
>>> [hidden email]
>>> 520-770-3500
>>>
>>>
>>>
>>>
>>> Sarah_S wrote:
>>>> Hi all,
>>>>
>>>> I want to harvets from csw nodes (server).
>>>> So I use the harvesting management and add these URLS (after selecting
>>>> the
>>>> right type;-)):
>>>> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
>>>> (from there:
>>>> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
>>>> link of another thread
>>>> and
>>>> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
>>>> but both send me error. If I type these urls in my browser (firefox) I
>>>> get a
>>>> respond.
>>>> First one said UnknownHostException and second NoRouteToHostException.
>>>>
>>>> I think I did domething wrong because of not understanding harvesting,
>>>> csw
>>>> correctly.
>>>> Can anybody perhaps explain me some important things? It would be very
>>>> appreciated!
>>>>
>>>> I read the manual (so I know now that harvestes metadata could not be
>>>> changed ;-)) but did not find a solution for my problem.
>>>>
>>>> Thanks.
>>>> best regards
>>>> Sarah
>>>>
>>>>  
>>> ------------------------------------------------------------------------------
>>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>>> is the only developer event you need to attend this year. Jumpstart your
>>> developing skills, take BlackBerry mobile applications to market and stay
>>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>>> http://p.sf.net/sfu/devconference
>>> _______________________________________________
>>> GeoNetwork-users mailing list
>>> [hidden email]
>>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>> GeoNetwork OpenSource is maintained at
>>> http://sourceforge.net/projects/geonetwork
>>>
>>>
>>
>
>
>


--
Douglas D. Nebert
Senior Advisor for Geospatial Technology, System-of-Systems Architect
FGDC Secretariat   T:703 648 4151    F:703 648-5755    C:703 459-5860



------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
josegar74

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
Hi

I tried with trunk code:

1)
http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2

seems working ok, but going to check with installer to be sure.

2)
http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.

It's a problem in GN processing the GetRecords posts URL's in
GetCapabilities for this server (this error should happen also with old
versions of GN).

It has two post urls, SOAP and XML, but only the first SOAP url is processed
(and it's not supported in GN, so it's why getting the error GetRecords
operation not found). Fixing first to almost process all posts urls and get
a supported URL and later I'll change it to support SOAP url calls also.

<ows:Operation name="GetRecords">
 <ows:DCP>
  <ows:HTTP>
   <ows:Post xlink:href="http://www.portalu.de:80/csw202">

    <ows:Constraint name="PostEncoding">
    <ows:Value>SOAP</ows:Value>
    </ows:Constraint>
   </ows:Post>

   <ows:Post xlink:href="http://www.portalu.de:80/csw202">
    <ows:Constraint name="PostEncoding">
    <ows:Value>XML</ows:Value>
    </ows:Constraint>
   </ows:Post>
  </ows:HTTP>
 </ows:DCP>

I hope to commit today the fix for this, so in next release should be
avalaible. Also testing with more CSW servers to verify correctness in
harvesting.

Regards,
Jose García

----- Original Message -----
From: "Doug Nebert" <[hidden email]>
To: "Sarah_S" <[hidden email]>
Cc: <[hidden email]>
Sent: Wednesday, October 28, 2009 4:16 PM
Subject: Re: [GeoNetwork-users] Harvesting CSW


> Sarah_S wrote:
>> Still having problems with harvesting management after trying for some
>> weeks.
>> So I get some other errors which I don`t know if it is a geonetwork
>> problem
>> or a intranet/system problem.
>
> I have installed GeoNetwork 2.4.2 in Linux and Windows and have been
> UNABLE to perform a successful CSW harvest to several attempted (and
> well-behaving) CSW targets, including the other GN instance CSW server!
> Like you, I get the same NullPointerException error. I have initiated a
> bug report in the http://trac.osgeo.org/geonetwork/ system.
>
> This is definitely a bug - does anyone have success with CSW 2.0.2
> harvest in GN 2.4.2?
>
> Doug.
>
>> We use a proxy with a PAC-File (which I specify at system configuration).
>> Do
>> we need to use Apache http or something for proxy?
>> I tried serveral harvesting with csw server and wms but none worked.
>> I get this strange stacktrace-popup (see picture) - is it right behavior?
>> So I get an "OperationAbortedEx: raised exception when searching.
>> NullpointerException" in most cases (with this url e.g.
>> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2
>> ) or "OperationAborted: GetRecords operation not found" with this url:
>> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.
>> I can reach and get respond via webbrowser so the urls are valid.
>> Any hints are appreciated.
>>
>> Thanks.
>>
>> best regards
>> Sarah
>> http://n2.nabble.com/file/n3904733/gn_harvest2.jpg
>> http://n2.nabble.com/file/n3904733/geonetwork_harvest.jpg
>>
>>
>>
>> Sarah_S wrote:
>>> Thank you Wolfgang for information.
>>>
>>> I tried it with other services/URL´s but none worked. That´s why I
>>> suppose
>>> that I´m doing something wrong. So my procedure:
>>> I looged in with admin, went to harvesting management, click on add,
>>> choose Web Catalogue for the Web 2.0 and in next editor I enter my URL,
>>> Name for this csw, no user and password, choose a group ("sample group")
>>> and a register. I don´t believe that I need user and password do I?
>>>
>>> Any further ideas?
>>> Thanks.
>>>
>>> best regards
>>> Sarah
>>>
>>>
>>> wgrunberg wrote:
>>>> Dear Sarah,
>>>>
>>>> Sorry, our CSW development service
>>>> (http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
>>>> is not working properly because of a bug with deegree_csw 1.3pre.
>>>> Deegree's CSW server returns some bogus elements
>>>> (http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
>>>> which will be fixed with the next release.
>>>>
>>>> Ciao, Wolfgang
>>>>
>>>> _______________________________
>>>> Wolfgang Grunberg
>>>> Arizona Geological Survey
>>>> [hidden email]
>>>> 520-770-3500
>>>>
>>>>
>>>>
>>>>
>>>> Sarah_S wrote:
>>>>> Hi all,
>>>>>
>>>>> I want to harvets from csw nodes (server).
>>>>> So I use the harvesting management and add these URLS (after selecting
>>>>> the
>>>>> right type;-)):
>>>>> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
>>>>> (from there:
>>>>> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
>>>>> link of another thread
>>>>> and
>>>>> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
>>>>> but both send me error. If I type these urls in my browser (firefox) I
>>>>> get a
>>>>> respond.
>>>>> First one said UnknownHostException and second NoRouteToHostException.
>>>>>
>>>>> I think I did domething wrong because of not understanding harvesting,
>>>>> csw
>>>>> correctly.
>>>>> Can anybody perhaps explain me some important things? It would be very
>>>>> appreciated!
>>>>>
>>>>> I read the manual (so I know now that harvestes metadata could not be
>>>>> changed ;-)) but did not find a solution for my problem.
>>>>>
>>>>> Thanks.
>>>>> best regards
>>>>> Sarah
>>>>>
>>>>>
>>>> ------------------------------------------------------------------------------
>>>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>>>> is the only developer event you need to attend this year. Jumpstart
>>>> your
>>>> developing skills, take BlackBerry mobile applications to market and
>>>> stay
>>>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>>>> http://p.sf.net/sfu/devconference
>>>> _______________________________________________
>>>> GeoNetwork-users mailing list
>>>> [hidden email]
>>>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>>> GeoNetwork OpenSource is maintained at
>>>> http://sourceforge.net/projects/geonetwork
>>>>
>>>>
>>>
>>
>>
>>
>
>
> --
> Douglas D. Nebert
> Senior Advisor for Geospatial Technology, System-of-Systems Architect
> FGDC Secretariat   T:703 648 4151    F:703 648-5755    C:703 459-5860
>
>
>
> ------------------------------------------------------------------------------
> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
> is the only developer event you need to attend this year. Jumpstart your
> developing skills, take BlackBerry mobile applications to market and stay
> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> http://p.sf.net/sfu/devconference
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>


------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
armin11

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
hi,
here is a list with some scw 2.0.2 servers you can test with.
http://www.mapbender.org/CSW_Requirements
regards and thanx o lot for fixing this
armin

Am Donnerstag 29 Oktober 2009 10:41:05 schrieb Jose García:

> Hi
>
> I tried with trunk code:
>
> 1)
> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&versi
>on=2.0.2
>
> seems working ok, but going to check with installer to be sure.
>
> 2)
> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=
>CSW.
>
> It's a problem in GN processing the GetRecords posts URL's in
> GetCapabilities for this server (this error should happen also with old
> versions of GN).
>
> It has two post urls, SOAP and XML, but only the first SOAP url is
> processed (and it's not supported in GN, so it's why getting the error
> GetRecords operation not found). Fixing first to almost process all posts
> urls and get a supported URL and later I'll change it to support SOAP url
> calls also.
>
> <ows:Operation name="GetRecords">
>  <ows:DCP>
>   <ows:HTTP>
>    <ows:Post xlink:href="http://www.portalu.de:80/csw202">
>
>     <ows:Constraint name="PostEncoding">
>     <ows:Value>SOAP</ows:Value>
>     </ows:Constraint>
>    </ows:Post>
>
>    <ows:Post xlink:href="http://www.portalu.de:80/csw202">
>     <ows:Constraint name="PostEncoding">
>     <ows:Value>XML</ows:Value>
>     </ows:Constraint>
>    </ows:Post>
>   </ows:HTTP>
>  </ows:DCP>
>
> I hope to commit today the fix for this, so in next release should be
> avalaible. Also testing with more CSW servers to verify correctness in
> harvesting.
>
> Regards,
> Jose García
>
> ----- Original Message -----
> From: "Doug Nebert" <[hidden email]>
> To: "Sarah_S" <[hidden email]>
> Cc: <[hidden email]>
> Sent: Wednesday, October 28, 2009 4:16 PM
> Subject: Re: [GeoNetwork-users] Harvesting CSW
>
> > Sarah_S wrote:
> >> Still having problems with harvesting management after trying for some
> >> weeks.
> >> So I get some other errors which I don`t know if it is a geonetwork
> >> problem
> >> or a intranet/system problem.
> >
> > I have installed GeoNetwork 2.4.2 in Linux and Windows and have been
> > UNABLE to perform a successful CSW harvest to several attempted (and
> > well-behaving) CSW targets, including the other GN instance CSW server!
> > Like you, I get the same NullPointerException error. I have initiated a
> > bug report in the http://trac.osgeo.org/geonetwork/ system.
> >
> > This is definitely a bug - does anyone have success with CSW 2.0.2
> > harvest in GN 2.4.2?
> >
> > Doug.
> >
> >> We use a proxy with a PAC-File (which I specify at system
> >> configuration). Do
> >> we need to use Apache http or something for proxy?
> >> I tried serveral harvesting with csw server and wms but none worked.
> >> I get this strange stacktrace-popup (see picture) - is it right
> >> behavior? So I get an "OperationAbortedEx: raised exception when
> >> searching. NullpointerException" in most cases (with this url e.g.
> >> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&ve
> >>rsion=2.0.2 ) or "OperationAborted: GetRecords operation not found" with
> >> this url:
> >> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVI
> >>CE=CSW. I can reach and get respond via webbrowser so the urls are valid.
> >> Any hints are appreciated.
> >>
> >> Thanks.
> >>
> >> best regards
> >> Sarah
> >> http://n2.nabble.com/file/n3904733/gn_harvest2.jpg
> >> http://n2.nabble.com/file/n3904733/geonetwork_harvest.jpg
> >>
> >> Sarah_S wrote:
> >>> Thank you Wolfgang for information.
> >>>
> >>> I tried it with other services/URL´s but none worked. That´s why I
> >>> suppose
> >>> that I´m doing something wrong. So my procedure:
> >>> I looged in with admin, went to harvesting management, click on add,
> >>> choose Web Catalogue for the Web 2.0 and in next editor I enter my URL,
> >>> Name for this csw, no user and password, choose a group ("sample
> >>> group") and a register. I don´t believe that I need user and password
> >>> do I?
> >>>
> >>> Any further ideas?
> >>> Thanks.
> >>>
> >>> best regards
> >>> Sarah
> >>>
> >>> wgrunberg wrote:
> >>>> Dear Sarah,
> >>>>
> >>>> Sorry, our CSW development service
> >>>> (http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabiliti
> >>>>es&service=CSW&acceptVersions=2.0.2) is not working properly because of
> >>>> a bug with deegree_csw 1.3pre. Deegree's CSW server returns some bogus
> >>>> elements
> >>>> (http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-c
> >>>>sw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3
> >>>>787834) which will be fixed with the next release.
> >>>>
> >>>> Ciao, Wolfgang
> >>>>
> >>>> _______________________________
> >>>> Wolfgang Grunberg
> >>>> Arizona Geological Survey
> >>>> [hidden email]
> >>>> 520-770-3500
> >>>>
> >>>> Sarah_S wrote:
> >>>>> Hi all,
> >>>>>
> >>>>> I want to harvets from csw nodes (server).
> >>>>> So I use the harvesting management and add these URLS (after
> >>>>> selecting the
> >>>>> right type;-)):
> >>>>> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=
> >>>>>GetCapabilities (from there:
> >>>>> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014
> >>>>>451 link of another thread
> >>>>> and
> >>>>> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabiliti
> >>>>>es&service=CSW&acceptVersions=2.0.2 but both send me error. If I type
> >>>>> these urls in my browser (firefox) I get a
> >>>>> respond.
> >>>>> First one said UnknownHostException and second
> >>>>> NoRouteToHostException.
> >>>>>
> >>>>> I think I did domething wrong because of not understanding
> >>>>> harvesting, csw
> >>>>> correctly.
> >>>>> Can anybody perhaps explain me some important things? It would be
> >>>>> very appreciated!
> >>>>>
> >>>>> I read the manual (so I know now that harvestes metadata could not be
> >>>>> changed ;-)) but did not find a solution for my problem.
> >>>>>
> >>>>> Thanks.
> >>>>> best regards
> >>>>> Sarah
> >>>>
> >>>> ----------------------------------------------------------------------
> >>>>-------- Come build with us! The BlackBerry(R) Developer Conference in
> >>>> SF, CA is the only developer event you need to attend this year.
> >>>> Jumpstart your
> >>>> developing skills, take BlackBerry mobile applications to market and
> >>>> stay
> >>>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> >>>> http://p.sf.net/sfu/devconference
> >>>> _______________________________________________
> >>>> GeoNetwork-users mailing list
> >>>> [hidden email]
> >>>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> >>>> GeoNetwork OpenSource is maintained at
> >>>> http://sourceforge.net/projects/geonetwork
> >
> > --
> > Douglas D. Nebert
> > Senior Advisor for Geospatial Technology, System-of-Systems Architect
> > FGDC Secretariat   T:703 648 4151    F:703 648-5755    C:703 459-5860
> >
> >
> >
> > -------------------------------------------------------------------------
> >----- Come build with us! The BlackBerry(R) Developer Conference in SF, CA
> > is the only developer event you need to attend this year. Jumpstart your
> > developing skills, take BlackBerry mobile applications to market and stay
> > ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> > http://p.sf.net/sfu/devconference
> > _______________________________________________
> > GeoNetwork-users mailing list
> > [hidden email]
> > https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> > GeoNetwork OpenSource is maintained at
> > http://sourceforge.net/projects/geonetwork
>
> ---------------------------------------------------------------------------
>--- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is
> the only developer event you need to attend this year. Jumpstart your
> developing skills, take BlackBerry mobile applications to market and stay
> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> http://p.sf.net/sfu/devconference
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork



--
Im Auftrag
--
Armin Retterath

Kompetenz- und Geschäftsstelle Geodateninfrastruktur Rheinland-Pfalz
beim
Landesamt für Vermessung und Geobasisinformation Rheinland-Pfalz

Ferdinand-Sauerbruch-Straße 15
56073 Koblenz
Telefon 0261/492-466
Telefax 0261/492-492
[hidden email]
http://www.geoportal.rlp.de

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Sarah_S

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
In reply to this post by josegar74
Hi Jose,

thanks for this explanation. I know that SOAP is not supported through gn but I did not know that there is a problem if the csw has both SOAP and XML (REST).
But could you say something about my exceptions so my harvest from the first link fails?

Thanks.
best regards
Sarah

josegar74 wrote:
Hi

I tried with trunk code:

1)
http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2

seems working ok, but going to check with installer to be sure.

2)
http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.

It's a problem in GN processing the GetRecords posts URL's in
GetCapabilities for this server (this error should happen also with old
versions of GN).

It has two post urls, SOAP and XML, but only the first SOAP url is processed
(and it's not supported in GN, so it's why getting the error GetRecords
operation not found). Fixing first to almost process all posts urls and get
a supported URL and later I'll change it to support SOAP url calls also.

<ows:Operation name="GetRecords">
 <ows:DCP>
  <ows:HTTP>
   <ows:Post xlink:href="http://www.portalu.de:80/csw202">

    <ows:Constraint name="PostEncoding">
    <ows:Value>SOAP</ows:Value>
    </ows:Constraint>
   </ows:Post>

   <ows:Post xlink:href="http://www.portalu.de:80/csw202">
    <ows:Constraint name="PostEncoding">
    <ows:Value>XML</ows:Value>
    </ows:Constraint>
   </ows:Post>
  </ows:HTTP>
 </ows:DCP>

I hope to commit today the fix for this, so in next release should be
avalaible. Also testing with more CSW servers to verify correctness in
harvesting.

Regards,
Jose García

----- Original Message -----
From: "Doug Nebert" <ddnebert@usgs.gov>
To: "Sarah_S" <Sarah_flip@yahoo.de>
Cc: <geonetwork-users@lists.sourceforge.net>
Sent: Wednesday, October 28, 2009 4:16 PM
Subject: Re: [GeoNetwork-users] Harvesting CSW


> Sarah_S wrote:
>> Still having problems with harvesting management after trying for some
>> weeks.
>> So I get some other errors which I don`t know if it is a geonetwork
>> problem
>> or a intranet/system problem.
>
> I have installed GeoNetwork 2.4.2 in Linux and Windows and have been
> UNABLE to perform a successful CSW harvest to several attempted (and
> well-behaving) CSW targets, including the other GN instance CSW server!
> Like you, I get the same NullPointerException error. I have initiated a
> bug report in the http://trac.osgeo.org/geonetwork/ system.
>
> This is definitely a bug - does anyone have success with CSW 2.0.2
> harvest in GN 2.4.2?
>
> Doug.
>
>> We use a proxy with a PAC-File (which I specify at system configuration).
>> Do
>> we need to use Apache http or something for proxy?
>> I tried serveral harvesting with csw server and wms but none worked.
>> I get this strange stacktrace-popup (see picture) - is it right behavior?
>> So I get an "OperationAbortedEx: raised exception when searching.
>> NullpointerException" in most cases (with this url e.g.
>> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2
>> ) or "OperationAborted: GetRecords operation not found" with this url:
>> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.
>> I can reach and get respond via webbrowser so the urls are valid.
>> Any hints are appreciated.
>>
>> Thanks.
>>
>> best regards
>> Sarah
>> http://n2.nabble.com/file/n3904733/gn_harvest2.jpg
>> http://n2.nabble.com/file/n3904733/geonetwork_harvest.jpg
>>
>>
>>
>> Sarah_S wrote:
>>> Thank you Wolfgang for information.
>>>
>>> I tried it with other services/URL´s but none worked. That´s why I
>>> suppose
>>> that I´m doing something wrong. So my procedure:
>>> I looged in with admin, went to harvesting management, click on add,
>>> choose Web Catalogue for the Web 2.0 and in next editor I enter my URL,
>>> Name for this csw, no user and password, choose a group ("sample group")
>>> and a register. I don´t believe that I need user and password do I?
>>>
>>> Any further ideas?
>>> Thanks.
>>>
>>> best regards
>>> Sarah
>>>
>>>
>>> wgrunberg wrote:
>>>> Dear Sarah,
>>>>
>>>> Sorry, our CSW development service
>>>> (http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
>>>> is not working properly because of a bug with deegree_csw 1.3pre.
>>>> Deegree's CSW server returns some bogus elements
>>>> (http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
>>>> which will be fixed with the next release.
>>>>
>>>> Ciao, Wolfgang
>>>>
>>>> _______________________________
>>>> Wolfgang Grunberg
>>>> Arizona Geological Survey
>>>> wgrunberg@azgs.az.gov
>>>> 520-770-3500
>>>>
>>>>
>>>>
>>>>
>>>> Sarah_S wrote:
>>>>> Hi all,
>>>>>
>>>>> I want to harvets from csw nodes (server).
>>>>> So I use the harvesting management and add these URLS (after selecting
>>>>> the
>>>>> right type;-)):
>>>>> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
>>>>> (from there:
>>>>> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
>>>>> link of another thread
>>>>> and
>>>>> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
>>>>> but both send me error. If I type these urls in my browser (firefox) I
>>>>> get a
>>>>> respond.
>>>>> First one said UnknownHostException and second NoRouteToHostException.
>>>>>
>>>>> I think I did domething wrong because of not understanding harvesting,
>>>>> csw
>>>>> correctly.
>>>>> Can anybody perhaps explain me some important things? It would be very
>>>>> appreciated!
>>>>>
>>>>> I read the manual (so I know now that harvestes metadata could not be
>>>>> changed ;-)) but did not find a solution for my problem.
>>>>>
>>>>> Thanks.
>>>>> best regards
>>>>> Sarah
>>>>>
>>>>>
>>>> ------------------------------------------------------------------------------
>>>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>>>> is the only developer event you need to attend this year. Jumpstart
>>>> your
>>>> developing skills, take BlackBerry mobile applications to market and
>>>> stay
>>>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>>>> http://p.sf.net/sfu/devconference
>>>> _______________________________________________
>>>> GeoNetwork-users mailing list
>>>> GeoNetwork-users@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>>> GeoNetwork OpenSource is maintained at
>>>> http://sourceforge.net/projects/geonetwork
>>>>
>>>>
>>>
>>
>>
>>
>
>
> --
> Douglas D. Nebert
> Senior Advisor for Geospatial Technology, System-of-Systems Architect
> FGDC Secretariat   T:703 648 4151    F:703 648-5755    C:703 459-5860
>
>
>
> ------------------------------------------------------------------------------
> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
> is the only developer event you need to attend this year. Jumpstart your
> developing skills, take BlackBerry mobile applications to market and stay
> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> http://p.sf.net/sfu/devconference
> _______________________________________________
> GeoNetwork-users mailing list
> GeoNetwork-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>


------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
josegar74

Re: Harvesting CSW

Reply Threaded More More options
Print post
Permalink
Hi Sarah

I tried
http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2 
with GN 242 installer and works ok for me. I tested without proxy and using
the proxy provided with JMeter.

Not sure about how PAC-File works. Can you provide more info (proxy
software, config used)?

Regards,
Jose García

----- Original Message -----
From: "Sarah_S" <[hidden email]>
To: <[hidden email]>
Sent: Thursday, October 29, 2009 11:19 AM
Subject: Re: [GeoNetwork-users] Harvesting CSW


>
> Hi Jose,
>
> thanks for this explanation. I know that SOAP is not supported through gn
> but I did not know that there is a problem if the csw has both SOAP and
> XML
> (REST).
> But could you say something about my exceptions so my harvest from the
> first
> link fails?
>
> Thanks.
> best regards
> Sarah
>
>
> josegar74 wrote:
>>
>> Hi
>>
>> I tried with trunk code:
>>
>> 1)
>> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2
>>
>> seems working ok, but going to check with installer to be sure.
>>
>> 2)
>> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.
>>
>> It's a problem in GN processing the GetRecords posts URL's in
>> GetCapabilities for this server (this error should happen also with old
>> versions of GN).
>>
>> It has two post urls, SOAP and XML, but only the first SOAP url is
>> processed
>> (and it's not supported in GN, so it's why getting the error GetRecords
>> operation not found). Fixing first to almost process all posts urls and
>> get
>> a supported URL and later I'll change it to support SOAP url calls also.
>>
>> <ows:Operation name="GetRecords">
>>  <ows:DCP>
>>   <ows:HTTP>
>>    <ows:Post xlink:href="http://www.portalu.de:80/csw202">
>>
>>     <ows:Constraint name="PostEncoding">
>>     <ows:Value>SOAP</ows:Value>
>>     </ows:Constraint>
>>    </ows:Post>
>>
>>    <ows:Post xlink:href="http://www.portalu.de:80/csw202">
>>     <ows:Constraint name="PostEncoding">
>>     <ows:Value>XML</ows:Value>
>>     </ows:Constraint>
>>    </ows:Post>
>>   </ows:HTTP>
>>  </ows:DCP>
>>
>> I hope to commit today the fix for this, so in next release should be
>> avalaible. Also testing with more CSW servers to verify correctness in
>> harvesting.
>>
>> Regards,
>> Jose García
>>
>> ----- Original Message -----
>> From: "Doug Nebert" <[hidden email]>
>> To: "Sarah_S" <[hidden email]>
>> Cc: <[hidden email]>
>> Sent: Wednesday, October 28, 2009 4:16 PM
>> Subject: Re: [GeoNetwork-users] Harvesting CSW
>>
>>
>>> Sarah_S wrote:
>>>> Still having problems with harvesting management after trying for some
>>>> weeks.
>>>> So I get some other errors which I don`t know if it is a geonetwork
>>>> problem
>>>> or a intranet/system problem.
>>>
>>> I have installed GeoNetwork 2.4.2 in Linux and Windows and have been
>>> UNABLE to perform a successful CSW harvest to several attempted (and
>>> well-behaving) CSW targets, including the other GN instance CSW server!
>>> Like you, I get the same NullPointerException error. I have initiated a
>>> bug report in the http://trac.osgeo.org/geonetwork/ system.
>>>
>>> This is definitely a bug - does anyone have success with CSW 2.0.2
>>> harvest in GN 2.4.2?
>>>
>>> Doug.
>>>
>>>> We use a proxy with a PAC-File (which I specify at system
>>>> configuration).
>>>> Do
>>>> we need to use Apache http or something for proxy?
>>>> I tried serveral harvesting with csw server and wms but none worked.
>>>> I get this strange stacktrace-popup (see picture) - is it right
>>>> behavior?
>>>> So I get an "OperationAbortedEx: raised exception when searching.
>>>> NullpointerException" in most cases (with this url e.g.
>>>> http://geomatics.nlr.nl/excat/csw?request=GetCapabilities&service=CSW&version=2.0.2
>>>> ) or "OperationAborted: GetRecords operation not found" with this url:
>>>> http://www.portalu.de/csw202?REQUEST=GetCapabilities&VERSION=2.0.2&SERVICE=CSW.
>>>> I can reach and get respond via webbrowser so the urls are valid.
>>>> Any hints are appreciated.
>>>>
>>>> Thanks.
>>>>
>>>> best regards
>>>> Sarah
>>>> http://n2.nabble.com/file/n3904733/gn_harvest2.jpg
>>>> http://n2.nabble.com/file/n3904733/geonetwork_harvest.jpg
>>>>
>>>>
>>>>
>>>> Sarah_S wrote:
>>>>> Thank you Wolfgang for information.
>>>>>
>>>>> I tried it with other services/URL´s but none worked. That´s why I
>>>>> suppose
>>>>> that I´m doing something wrong. So my procedure:
>>>>> I looged in with admin, went to harvesting management, click on add,
>>>>> choose Web Catalogue for the Web 2.0 and in next editor I enter my
>>>>> URL,
>>>>> Name for this csw, no user and password, choose a group ("sample
>>>>> group")
>>>>> and a register. I don´t believe that I need user and password do I?
>>>>>
>>>>> Any further ideas?
>>>>> Thanks.
>>>>>
>>>>> best regards
>>>>> Sarah
>>>>>
>>>>>
>>>>> wgrunberg wrote:
>>>>>> Dear Sarah,
>>>>>>
>>>>>> Sorry, our CSW development service
>>>>>> (http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2)
>>>>>> is not working properly because of a bug with deegree_csw 1.3pre.
>>>>>> Deegree's CSW server returns some bogus elements
>>>>>> (http://n2.nabble.com/Deegree-is-not-using-the-correct-output-schema-csw-AbstractRecord-for-outputSchema-http-www-opengis-2-tt3757690.html#a3787834)
>>>>>> which will be fixed with the next release.
>>>>>>
>>>>>> Ciao, Wolfgang
>>>>>>
>>>>>> _______________________________
>>>>>> Wolfgang Grunberg
>>>>>> Arizona Geological Survey
>>>>>> [hidden email]
>>>>>> 520-770-3500
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Sarah_S wrote:
>>>>>>> Hi all,
>>>>>>>
>>>>>>> I want to harvets from csw nodes (server).
>>>>>>> So I use the harvesting management and add these URLS (after
>>>>>>> selecting
>>>>>>> the
>>>>>>> right type;-)):
>>>>>>> http://sandre.eaufrance.fr/geonetwork/srv/fr/csw?SERVICE=CSW&REQUEST=GetCapabilities
>>>>>>> (from there:
>>>>>>> http://n2.nabble.com/Real-interoperability-tests-td2014451.html#a2014451
>>>>>>> link of another thread
>>>>>>> and
>>>>>>> http://75.101.143.247:8080/deegree-csw/services?REQUEST=GetCapabilities&service=CSW&acceptVersions=2.0.2
>>>>>>> but both send me error. If I type these urls in my browser (firefox)
>>>>>>> I
>>>>>>> get a
>>>>>>> respond.
>>>>>>> First one said UnknownHostException and second
>>>>>>> NoRouteToHostException.
>>>>>>>
>>>>>>> I think I did domething wrong because of not understanding
>>>>>>> harvesting,
>>>>>>> csw
>>>>>>> correctly.
>>>>>>> Can anybody perhaps explain me some important things? It would be
>>>>>>> very
>>>>>>> appreciated!
>>>>>>>
>>>>>>> I read the manual (so I know now that harvestes metadata could not
>>>>>>> be
>>>>>>> changed ;-)) but did not find a solution for my problem.
>>>>>>>
>>>>>>> Thanks.
>>>>>>> best regards
>>>>>>> Sarah
>>>>>>>
>>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>>>>>> is the only developer event you need to attend this year. Jumpstart
>>>>>> your
>>>>>> developing skills, take BlackBerry mobile applications to market and
>>>>>> stay
>>>>>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>>>>>> http://p.sf.net/sfu/devconference
>>>>>> _______________________________________________
>>>>>> GeoNetwork-users mailing list
>>>>>> [hidden email]
>>>>>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>>>>> GeoNetwork OpenSource is maintained at
>>>>>> http://sourceforge.net/projects/geonetwork
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Douglas D. Nebert
>>> Senior Advisor for Geospatial Technology, System-of-Systems Architect
>>> FGDC Secretariat   T:703 648 4151    F:703 648-5755    C:703 459-5860
>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>>> is the only developer event you need to attend this year. Jumpstart your
>>> developing skills, take BlackBerry mobile applications to market and
>>> stay
>>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>>> http://p.sf.net/sfu/devconference
>>> _______________________________________________
>>> GeoNetwork-users mailing list
>>> [hidden email]
>>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>> GeoNetwork OpenSource is maintained at
>>> http://sourceforge.net/projects/geonetwork
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
>> is the only developer event you need to attend this year. Jumpstart your
>> developing skills, take BlackBerry mobile applications to market and stay
>> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
>> http://p.sf.net/sfu/devconference
>> _______________________________________________
>> GeoNetwork-users mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>> GeoNetwork OpenSource is maintained at
>> http://sourceforge.net/projects/geonetwork
>>
>>
>
> --
> View this message in context:
> http://n2.nabble.com/Harvesting-CSW-tp3829318p3910961.html
> Sent from the GeoNetwork users mailing list archive at Nabble.com.
>
> ------------------------------------------------------------------------------
> Come build with us! The BlackBerry(R) Developer Conference in SF, CA
> is the only developer event you need to attend this year. Jumpstart your
> developing skills, take BlackBerry mobile applications to market and stay
> ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> http://p.sf.net/sfu/devconference
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>


------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork