align-toparrow-leftarrow-rightbackbellblockcalendarcamerachatcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-crosscrosseditfacebookglobegoogleimagesinstagramlocation-pinmagnifying-glassmailmoremuplabelShape 3 + Rectangle 1outlookpersonplusImported LayersImported LayersImported Layersshieldstartwitteryahoo

Social; management + monitoring tools

Shay Banon will be there to answer questions.

Meet at Quid, pizza, talk, main topic: management and monitoring. I will take 5 min to show an interactive command line client we have here at Quid, maybe we can get other people to show tools they developed?

Parking: at that time should be plenty of street parking.

Bikes: you can bring bikes into our office.

Join or login to comment.

  • Navid K.

    I meant to thank you guys earlier but got super busy towards the end of the sprint. Thanks to Mik and all speakers. The tuning recommendations were very valuable. Our ES nodes' performance was coming to a halt since we were on an old version 1.6 of OpenJDK which is totally unreliable. We ended up upgrading to the latest oracle version two days ago and see much quicker searches and so far no need to force restart daily, though it may be too early to tell. Our throughput is about 200 events/secs, two node cluster, 4 GB Ram. Will keep u posted...

    March 9, 2013

  • Ying L.

    Thank you for hosting the meetup, Mik! Looking forward to trying out elsec and gablit!

    1 · March 7, 2013

  • Andrew P.

    Hello Mik,

    Thanks for the beer, pizza and pie and hosting the ElasticSearch Meetup!

    Best regards, Andrew Paulsen
    BASIS TECHNOLOGY

    1 · March 7, 2013

  • Taras

    Thanks for hosting again Mik! Anyone interested, can check out Gablit beta at: http://gablit.com/beta/
    At the moment I do not have API documentation posted, but it is straight forward and everything used by the UI is final and will be supported going forward. Send me a message if you'd like to try it out or have any questions.

    1 · March 7, 2013

  • Sushant S.

    Thanks for hosting Mik! Thanks for coming everyone! The slides we showed are at: http://www.slideshare.net/sushantshankar1/20130306-sf-es-meetup-monitoring

    1 · March 7, 2013

  • Mik K.

    Thank you everyone for coming! The tool I showed lives at https://github.com/mkocikowski/elsec

    1 · March 6, 2013

  • Kirk S.

    Sorry for the late notice.

    March 6, 2013

  • Vinh N.

    Performance tuning

    March 6, 2013

  • Mik K.

    Quick demos:
    - Sushant: monitoring tools
    - Mik: interactive cli
    If you'd like to show something, reply to this.

    March 1, 2013

    • Taras

      I'd like to show a quick demo of a new event search public product we just launched this Monday. It is built on top of ElasticSearch and uses multi-field functionality to assist with relevancy.

      March 6, 2013

  • Mike M.

    I'll throw out another monitoring topic: 0.9 is really nice. It seems to be much more elegant at coping when memory starts to get full. As the system gets smarter and more self-optimizing, I imagine that some of the manual "optimizations" we have used in the past may do more harm than good. What is the new thinking on how best to optimize for index, shard, and cache sizes? For example: With 0.9+, how does one weigh the cost of streaming (TTL) deletes vs. large bulk deletes vs. just adding additional new indexes? How do facet caching considerations change and how best to determine if you are really running out of memory? With Lucene 4 and tiering, are there new rules of thumb on shard sizes? Any of this change significantly from 0.19?

    March 6, 2013

  • Mike M.

    A question perhaps related to management and monitoring: Having multiple different database apps in a production system is a real mgmt & monitoring pain. Is it now or will it soon be reasonable to just use ES for all database tasks? For example, if you are already using ES document search as a core element of your system, is it reasonable to just use the same ES instance to also store the minor database tables like user prefs that might have previously used a mySQL-type thing? Is it reasonable to store binary attachments such as photos directly in ES? Anyone have [good or bad] experience trying to use ES beyond just search, as an everyday database?

    March 6, 2013

  • Kirk S.

    Looking forward to it.

    March 6, 2013

  • Ewan M.

    Hi everyone,

    I am looking for someone to fill a short contract productizing an ElasticSearch installation for me.

    We have VMs on AWS using Git and Puppet for SCM, Logstash/Kibana for central syslog, and Graphite for monitoring.

    ES is currently running on a single machine for dev. I need someone to change that -- choose sharding and VM size for a production install, add monitoring and management, tuning, backup strategy, Puppetize all the things, and integrate with existing SCM.

    You would work from home but SF strongly preferred for initial face-to-face meeting.

    I can't make this week's event (it's my wife's birthday) but I'm happy to hear from you through email at [masked].

    March 5, 2013

  • Navid K.

    Thanks for setting up this meetup! I'm also interested on how to determine what performance tunings to make after digesting the output of the monitoring tools.

    Hope we can talk a little about that too!

    February 27, 2013

    • Sushant S.

      Thanks for you question Navid. I can talk a little bit about this.

      1 · March 4, 2013

  • John E.

    Conflicting meetup. Sorry guys :(

    March 4, 2013

  • Mik K.

    Questions: post them in response to this, give others a chance to look them over.

    March 1, 2013

    • Mik K.

      Is there a formal spec of the query dsl? Where?

      March 4, 2013

  • Ewan M.

    Would love to, but it's my wife's birthday, and there are rules...

    1 · March 3, 2013

  • A former member
    A former member

    Elsec!!!

    March 1, 2013

  • Sushant S.

    Thanks for organizing Mik!

    I can spend a few minutes talking about the monitoring tools that we use.

    1 · March 1, 2013

  • Ivan

    How is parking in the neighborhood?

    February 27, 2013

    • Mik K.

      In the evening should be plenty of street parking.

      February 28, 2013

  • Ahmed B.

    I can make it if you change the date to Tuesday!

    February 27, 2013

    • Mik K.

      Sorry, too many people already signed up for Wed, Wednesday it is.

      February 28, 2013

  • Viren P.

    Ya

    February 27, 2013

42 went

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy