Home | About | Sematext search-lucene.com search-hadoop.com
 Search Lucene and all its subprojects:

Switch to Plain View
Solr, mail # user - SolrCloud - issues running with embedded zookeeper ensemble


+
Dipti Srivastava 2012-01-27, 17:53
+
Mark Miller 2012-01-31, 18:18
Copy link to this message
-
Re: SolrCloud - issues running with embedded zookeeper ensemble
Dipti Srivastava 2012-02-02, 21:44
Hi Mark,
I am trying to set up on 4 ami's, where 3 of the instances will have the
embedded ZK running. Here are the startup commands for all 4.

- Note that on the 4th instance I do not have the ZK host and bootstrap
conf dir specified. The 4th instance throws exception (earlier in this
email chain) at startup.
- Ideally, I should not have to specify the host for the -DzkRun since it
is the localhost, but without that I get the exception as well.

1. java -DzkRun=ec2-compute-1.amazonaws.com:9983
-Dsolr.solr.home=/home/ec2-user/solrcloud/example/solr
-Dbootstrap_confdir=/home/ec2-user/solrcloud//example/solr/conf
-DzkHost=ec2-compute-1.amazonaws.com:9983,ec2-compute-2.amazonaws.com:9983,
ec2-compute-3.amazonaws.com:9983 -DnumShards=2 -jar start.jar
2. java -DzkRun=ec2-compute-2.amazonaws.com:9983
-Dsolr.solr.home=/home/ec2-user/solrcloud/example/solr
-Dbootstrap_confdir=/home/ec2-user/solrcloud//example/solr/conf
-DzkHost=ec2-compute-1.amazonaws.com:9983,ec2-compute-2.amazonaws.com:9983,
ec2-compute-3.amazonaws.com:9983 -DnumShards=2 -jar start.jar
3. java -DzkRun=ec2-compute-3.amazonaws.com:9983
-Dsolr.solr.home=/home/ec2-user/solrcloud/example/solr
-Dbootstrap_confdir=/home/ec2-user/solrcloud//example/solr/conf
-DzkHost=ec2-compute-1.amazonaws.com:9983,ec2-compute-2.amazonaws.com:9983,
ec2-compute-3.amazonaws.com:9983 -DnumShards=2 -jar start.jar
4. java -Dsolr.solr.home=/home/ec2-user/solrcloud/example/solr
-DzkHost=ec2-compute-1.amazonaws.com:9983,ec2-compute-2.amazonaws.com:9983,
ec2-compute-3.amazonaws.com:9983 -DnumShards=2 -jar start.jar
Thanks,
Dipti

On 1/31/12 10:18 AM, "Mark Miller" <[EMAIL PROTECTED]> wrote:

>Hey Dipti -
>
>Can you give the exact startup cmds you are using for each of the
>instances? I have got Example C going, so I'll have to try and dig into
>whatever you are seeing.
>
>- mark
>
>On Jan 27, 2012, at 12:53 PM, Dipti Srivastava wrote:
>
>> Hi Mark,
>> Did you get a chance to look into the issues with running the embedded
>>Zookeeper ensemble, as per Example C, from the
>>http://wiki.apache.org/solr/SolrCloud2
>>
>> Hi All,
>> Did anyone else run multiple shards with embedded zk ensemble
>>successfully? If so would like some tips on any issues that you came
>>across.
>>
>> Regards,
>> Dipti
>>
>> From: diptis <[EMAIL PROTECTED]>
>> Date: Fri, 23 Dec 2011 10:32:52 -0700
>> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> Subject: Re: Release build or code for SolrCloud
>>
>> Hi Mark,
>> There is some issue with specifying localhost vs actual host names for
>>zk. When I changed my script to specify the actual hostname (which
>>should be local by default) the first, 2nd and 3rd instances came up,
>>that have the embedded zk running. Now, I am getting the same exception
>>for the 4th AMI which in NOT part of the zookeeper ensemble. I want to
>>zk only on 3 of the 4 instances.
>>
>> java -Dbootstrap_confdir=./solr/conf ­DzkRun="<ami-1>9983>"
>> -DzkHost=<ami-1>:9983,<ami-2>:9983,<ami-3>:9983 -DnumShards=2 -jar
>> start.jar
>>
>> Dipti
>>
>> From: Mark Miller <[EMAIL PROTECTED]>
>> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> Date: Fri, 23 Dec 2011 09:34:52 -0700
>> To: diptis <[EMAIL PROTECTED]>
>> Subject: Re: Release build or code for SolrCloud
>>
>> I'm having trouble getting a quorum up using the built in SolrZkServer
>>as well - so i have not been able to replicate this - I'll have to keep
>>digging. Not sure if it's due to a ZooKeeper update or what yet.
>>
>> 2011/12/21 Dipti Srivastava <[EMAIL PROTECTED]>
>>> Hi Mark,
>>> Thanks! So now I am deploying a 4 node cluster on AMI's and the main
>>> instance that bootstraps the config to the zookeeper does not come up I
>>> get an exception as follows. My solrcloud.sh looks like
>>>
>>> #!/usr/bin/env bash
>>>
>>> cd ..
>>>
>>> rm -r -f example/solr/zoo_data
>>> rm -f example/example.log
>>>
>>> cd example
>>> #java -DzkRun -DnumShards=2 -DSTOP.PORT=7983 -DSTOP.KEY=key -jar
>

This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system.
+
Mark Miller 2012-02-03, 04:27
+
Dipti Srivastava 2012-02-03, 18:17
+
arin g 2012-02-16, 19:53
+
Mark Miller 2012-02-16, 22:00