Hi,

I am running solrcloud and i am able to add cores http://wiki.apache.org/solr/SolrCloud#Creating_cores_via_CoreAdmin but how does one remove cores. If i use the core admin unload command, distributed queries then error as they still query the removed core. Do I need to update zookeeper somehow?

Phil

On Jan 31, 2012, at 4:49 AM, Phil Hoy wrote:

> Hi,
>
> I am running solrcloud and i am able to add cores http://wiki.apache.org/solr/SolrCloud#Creating_cores_via_CoreAdmin but how does one remove cores. If i use the core admin unload command, distributed queries then error as they still query the removed core. Do I need to update zookeeper somehow?
>
> Phil
Hey Phil - yeah, currently you would have to manually remove the core from zookeeper. Once we see it, we expect it to be part of the index - perhaps we should remove it on an explicit core reload though?

What version of trunk are you using?

- Mark Miller
lucidimagination.com

Hi Mark,

I am using the embedded zookeeper server, how would you recommend I connect to it so that I can remove the missing core or is it only possible when using a stand-alone zookeeper instance?

You are of course correct the reload command as well a few others should cause a resync with the zookeepers state too.

I am currently using version 4.0.0.2011.12.12.09.26.56.

Phil

-----Original Message-----
From: Mark Miller [mailto:[EMAIL PROTECTED]]
Sent: 31 January 2012 16:09
To: [EMAIL PROTECTED]
Subject: Re: removing cores solrcloud
On Jan 31, 2012, at 4:49 AM, Phil Hoy wrote:

> Hi,
>
> I am running solrcloud and i am able to add cores http://wiki.apache.org/solr/SolrCloud#Creating_cores_via_CoreAdmin but how does one remove cores. If i use the core admin unload command, distributed queries then error as they still query the removed core. Do I need to update zookeeper somehow?
>
> Phil
Hey Phil - yeah, currently you would have to manually remove the core from zookeeper. Once we see it, we expect it to be part of the index - perhaps we should remove it on an explicit core reload though?

What version of trunk are you using?

- Mark Miller
lucidimagination.com


______________________________________________________________________
This email has been scanned by the brightsolid Email Security System. Powered by MessageLabs
______________________________________________________________________

On Jan 31, 2012, at 1:03 PM, Phil Hoy wrote:

> Hi Mark,
>
> I am using the embedded zookeeper server, how would you recommend I connect to it so that I can remove the missing core or is it only possible when using a stand-alone zookeeper instance?

Nope, both cases are the same - you just need a ZK tool and the ZK address to connect that tool to ZK. ZK itself comes with some command line scripts that you could use - their are also a couple GUI tools out there.

If you use eclipse, my favorite way to interact with ZK is http://www.massedynamic.org/mediawiki/index.php?title=Eclipse_Plug-in_for_ZooKeeper

I think (hard to remember what came in when) you just have to remove the node from /node_states and the overseer will update the cluster state. Sami Siren might be able to comment more on that.

I am looking into doing this automatically when you unload a SolrCore - https://issues.apache.org/jira/browse/SOLR-3080

>
> You are of course correct the reload command as well a few others should cause a resync with the zookeepers state too.
>
> I am currently using version 4.0.0.2011.12.12.09.26.56.
>
> Phil
>
> -----Original Message-----
> From: Mark Miller [mailto:[EMAIL PROTECTED]]
> Sent: 31 January 2012 16:09
> To: [EMAIL PROTECTED]
> Subject: Re: removing cores solrcloud
>
>
> On Jan 31, 2012, at 4:49 AM, Phil Hoy wrote:
>
>> Hi,
>>
>> I am running solrcloud and i am able to add cores http://wiki.apache.org/solr/SolrCloud#Creating_cores_via_CoreAdmin but how does one remove cores. If i use the core admin unload command, distributed queries then error as they still query the removed core. Do I need to update zookeeper somehow?
>>
>> Phil
>
>
> Hey Phil - yeah, currently you would have to manually remove the core from zookeeper. Once we see it, we expect it to be part of the index - perhaps we should remove it on an explicit core reload though?
>
> What version of trunk are you using?
>
> - Mark Miller
> lucidimagination.com
>
>
>
>
>
>
>
>
>
>
>
>
> ______________________________________________________________________
> This email has been scanned by the brightsolid Email Security System. Powered by MessageLabs
> ______________________________________________________________________

- Mark Miller
lucidimagination.com

Hi,

I have tried removing the entry from zookeeper as well as from solr via admin/cores?action=uload and still the distributed query hits the missing core. I guess there is no zookeeper watcher in solr to update the core/shard state used by search.

I got round the problem by doing the above then running a admin/cores?action=reload on any core in the collection, this seems to force the solr's distributed searcher to re-consult zookeeper.

Phil
-----Original Message-----
From: Mark Miller [mailto:[EMAIL PROTECTED]]
Sent: 31 January 2012 18:16
To: [EMAIL PROTECTED]
Subject: Re: removing cores solrcloud
On Jan 31, 2012, at 1:03 PM, Phil Hoy wrote:

> Hi Mark,
>
> I am using the embedded zookeeper server, how would you recommend I connect to it so that I can remove the missing core or is it only possible when using a stand-alone zookeeper instance?

Nope, both cases are the same - you just need a ZK tool and the ZK address to connect that tool to ZK. ZK itself comes with some command line scripts that you could use - their are also a couple GUI tools out there.

If you use eclipse, my favorite way to interact with ZK is http://www.massedynamic.org/mediawiki/index.php?title=Eclipse_Plug-in_for_ZooKeeper

I think (hard to remember what came in when) you just have to remove the node from /node_states and the overseer will update the cluster state. Sami Siren might be able to comment more on that.

I am looking into doing this automatically when you unload a SolrCore - https://issues.apache.org/jira/browse/SOLR-3080

>
> You are of course correct the reload command as well a few others should cause a resync with the zookeepers state too.
>
> I am currently using version 4.0.0.2011.12.12.09.26.56.
>
> Phil
>
> -----Original Message-----
> From: Mark Miller [mailto:[EMAIL PROTECTED]]
> Sent: 31 January 2012 16:09
> To: [EMAIL PROTECTED]
> Subject: Re: removing cores solrcloud
>
>
> On Jan 31, 2012, at 4:49 AM, Phil Hoy wrote:
>
>> Hi,
>>
>> I am running solrcloud and i am able to add cores http://wiki.apache.org/solr/SolrCloud#Creating_cores_via_CoreAdmin but how does one remove cores. If i use the core admin unload command, distributed queries then error as they still query the removed core. Do I need to update zookeeper somehow?
>>
>> Phil
>
>
> Hey Phil - yeah, currently you would have to manually remove the core from zookeeper. Once we see it, we expect it to be part of the index - perhaps we should remove it on an explicit core reload though?
>
> What version of trunk are you using?
>
> - Mark Miller
> lucidimagination.com
>
>
>
>
>
>
>
>
>
>
>
>
> ______________________________________________________________________
> This email has been scanned by the brightsolid Email Security System. Powered by MessageLabs
> ______________________________________________________________________

- Mark Miller
lucidimagination.com


______________________________________________________________________
This email has been scanned by the brightsolid Email Security System. Powered by MessageLabs
______________________________________________________________________