SolrCluster

Solr committers Anshum Gupta and Tim Potter tell us about the upcoming Solr 5 release. We discuss making Solr “easy to start, easy to finish” while continuing to add improvements and stability for experienced users. Hear more about SolrCloud hardening, clusterstate improvements, the schema and solrconfig APIs, easier ZooKeeper management, improved flexible and schemaless indexing, and overall ease-of-use improvements.

In this episode Solr committer, Shalin Mangar, discusses the CAP theorem (Consistency, Availability, Partition tolerance) and the durability of SolrCloud in the face of network partitions and other service interruptions typical of distributed systems. In particular, Shalin describes his work in testing Solr and ZooKeeper with Jepsen, a framework built in Clojure by Kyle Kingsbury to “[break] distributed systems so you don’t have to”. Tune in to learn about how SolrCloud handles the hazards of distributed computing as a highly scalable, fault-tolerant search and NoSQL engine.

Lucene/Solr Committers Steve Rowe and Tim Potter are back on SolrCluster to discuss how Lucidworks and the community are making changes and improvements to Solr to increase usability and add ease to the getting started experience. Steve and Tim discuss new features such as data-driven schema, start-up scripts, launching SolrCloud, and more.

This week, the SolrCluster team is joined by Rishi Easwaran from the AOL mail team. AOL has been known for their large-scale Solr deployment, with over 150B documents and 1.2B searches per day. Rishi shares AOL’s reasons for choosing Solr for mail search, an overview of their multicore architecture before migrating to SolrCloud, and their new hybrid SolrCloud architecture, its performance, scalability, cost benefits, and lessons learned throughout the process. Rishi is a principal software engineer at AOL. He has worked with the AOL mail team since 2008, as the tech lead for the existing mail search infrastructure and re-architecture efforts to implement a multi-tiered high availability, large scale hybrid SolrCloud solution. Over the years, his entire team has focused on performance, availability, and scalability of Solr. In efforts to accomplish this, they’ve delved into the source code and have developed a close working knowledge and experience with Solr. Rishi gave a more detailed talk about AOL’s Solr deployment at a recent Code Brew Meetup in Dulles. Check out the video and slides here.

Steve Rowe, Lucene/Solr Committer, PMC Member and Lucidworks Sr. Engineer, joins the SolrCluster team for a follow up discussion to the webinar he was recently featured in. Steve talks about how Solr 4 has evolved since its release in 2012, some of the major features and changes in 4.7, 4.8 and 4.9, and the trajectory of future Solr releases. Steve also gives insight into what he’s been working on for Lucidworks, side projects he’s involved in and what he’s excited about. See the “What’s New in Solr” webinar replay here. Find out more about Steve’s side project, JFlex, here. Check out the Solr Reference Guide here.

On this week’s episode of SolrCluster, the team talks about Project Blacklight—an open source, front-end, discovery interface for Apache Solr—and how Blacklight is now a part of Project Hydra, a collaboration to help institutions around the world preserve, maintain and give access to their knowledge repositories and assets. Bess Sadler from the Stanford University Digital Library, a co-founder of Project Blacklight, joins us to discuss her involvement in the project, her vision for its future use and what she’s working on now. Bess Sadler is the Manager for Application Development in the Digital Library Systems group at Stanford University Library. She is one of the co-founders of Project Blacklight and Project Hydra, two open source software projects which are widely used by libraries and cultural institutions around the world. In addition to her responsibilities at Stanford, Bess is an active member in the larger library community working as a community organizer, workshop instructor, public speaker and general rabble-rouser. If you’re interested in Blacklight and Hydra, Bess also recommends the below resources. SpotlightLatest Spotlight Demo VideoGeoBlacklight

On this week's episode of SolrCluster, the team talks about Project Blacklight—an open source, front-end, discovery interface for Apache Solr—and how Blacklight is now a part of Project Hydra, a collaboration to help institutions around the world preserve, maintain and give access to their knowledge repositories and assets. Bess Sadler from the Stanford University Digital Library, a co-founder of Project Blacklight, joins us to discuss her involvement in the project, her vision for its future use and what she’s working on now. Bess Sadler is the Manager for Application Development in the Digital Library Systems group at Stanford University Library. She is one of the co-founders of Project Blacklight and Project Hydra, two open source software projects which are widely used by libraries and cultural institutions around the world. In addition to her responsibilities at Stanford, Bess is an active member in the larger library community working as a community organizer, workshop instructor, public speaker and general rabble-rouser. If you're interested in Blacklight and Hydra, Bess also recommends the below resources.SpotlightLatest Spotlight Demo VideoGeoBlacklightSolrCluster is hosted by Yann Yu and Adam Johnson. Questions? Email us at SolrCluster@lucidworks.com or on Twitter @LucidWorks #SolrCluster.

This week on SolrCluster, we are joined by Ravi Mynampaty and Katia Muser from Harvard Business School (HBS). Ravi and Katia share with us their experience migrating the Harvard Business School Alumni Website from Endeca to Lucidworks Search, Lucidworks’ commercial distribution of Solr. They explain how choosing the Solr approach saved them a ton of custom development and enabled them to offer end users features such as personalization, faceted search and navigation of various types of content (e.g., people, events, alumni stories) and autocomplete. The HBS search team chose Lucidworks Search because of the admin UI and ability to prototype very quickly. Members of the search team who did not have previous Solr experience were able to stand up, configure, and manage their Solr instance through the Lucidworks Search user interface. Katia Muser is a Technology Solution Architect at HBS.  She is a seasoned IT professional and has designed effective software solutions in various verticals such as higher education, insurance, finance, and automotive industries.  Most recently, she architected a Solr-driven search-based portal for the HBS Alumni website.  Katia has an M.S. in Mathematics and Computer Science from EPF Ecole d’Ingénieurs in France. Ravi Mynampaty refers to himself as “just another search guy standing tall on the shoulders of giants” and believes that making incremental changes is an effective path towards improving search and tries to make this happen on a daily basis.  He is currently working on Enterprise Search at HBS, which includes setting Enterprise Search strategy, design and implementation of findability standards, search tools, and search user interfaces. Ravi has masters degree in engineering from the University of Massachusetts and Brandeis University.

This week on SolrCluster, we are joined by Ravi Mynampaty and Katia Muser from Harvard Business School (HBS). Ravi and Katia share with us their experience migrating the Harvard Business School Alumni Website from Endeca to LucidWorks Search, LucidWorks' commercial distribution of Solr. They explain how choosing the Solr approach saved them a ton of custom development and enabled them to offer end users features such as personalization, faceted search and navigation of various types of content (e.g., people, events, alumni stories) and autocomplete. The HBS search team chose LucidWorks Search because of the admin UI and ability to prototype very quickly. Members of the search team who did not have previous Solr experience were able to stand up, configure, and manage their Solr instance through the LucidWorks Search user interface. Katia Muser is a Technology Solution Architect at HBS.  She is a seasoned IT professional and has designed effective software solutions in various verticals such as higher education, insurance, finance, and automotive industries.  Most recently, she architected a Solr-driven search-based portal for the HBS Alumni website.  Katia has an M.S. in Mathematics and Computer Science from EPF Ecole d'Ingénieurs in France.Ravi Mynampaty refers to himself as "just another search guy standing tall on the shoulders of giants" and believes that making incremental changes is an effective path towards improving search and tries to make this happen on a daily basis.  He is currently working on Enterprise Search at HBS, which includes setting Enterprise Search strategy, design and implementation of findability standards, search tools, and search user interfaces. Ravi has masters degree in engineering from the University of Massachusetts and Brandeis University.SolrCluster is hosted by Yann Yu and Adam Johnson. Questions? Email us at SolrCluster@lucidworks.com or on Twitter @LucidWorks #SolrCluster.

This week, the SolrCluster crew is joined by Lucidworks Chief of Product, Will Hayes, and Sematext Founder President, Otis Gospodnetić. Working with Solr since its origin in 2006, Otis has a wealth of experience around trends that have come about related to search and big data technologies. Otis and Will discuss tools that Sematext has built to help monitor Solr and other stacks, manage and analyze logs, and analyze search trends, as well as the general direction that industry leaders are moving toward around data acquisition and discovery as data increasingly grows. Otis Gospodnetić is a co-author of Lucene in Action (1st and 2nd editions).  He has been involved with Lucene since 2000 and Solr since 2006 and is a member of the Lucene Project Management Committee as well as the Apache Software Foundation.  Otis is the founder of Sematext Group, Inc.  Sematext provides consulting and commercial support for Solr and ElasticSearch, and runs SPM, a Monitoring, Alerting and Anomaly Detection service, along with Search Analytics and Log Analytics services. Check out Otis’ presentation from last year’s Lucene/Solr Revolution in Dublin, Solr for Analytics: Metrics Aggregations at Sematext.

This week, the SolrCluster team is joined by Trey Grainger, Director of Engineering for Search at CareerBuilder, and Timothy Potter, Lucene/Solr Committer and Senior Engineer at Lucidworks, to discuss their recently released co-authored book, Solr in Action.  Solr in Action is a comprehensive guide to implementing scalable search with Lucene/Solr, based on the real-world applications that Tim and Trey have worked on throughout the course of their careers in Solr. Tim and Trey share with us the challenges they faced, accomplishments they achieved, and what they learned in the process of co-authoring their first book.

This week, the SolrCluster team is joined by Trey Grainger, Director of Engineering for Search at CareerBuilder, and Timothy Potter, Lucene/Solr Committer and Senior Engineer at LucidWorks, to discuss their recently released co-authored book, Solr in Action.  Solr in Action is a comprehensive guide to implementing scalable search with Lucene/Solr, based on the real-world applications that Tim and Trey have worked on throughout the course of their careers in Solr. Tim and Trey share with us the challenges they faced, accomplishments they achieved, and what they learned in the process of co-authoring their first book. SolrCluster is hosted by: Yann Yu and Adam Johnson. Questions? email us at solrcluster@lucidworks.com or on twitter @LucidWorks #solrcluster.

This week the SolrCluster crew sits down with LucidWorks CEO Paul Doscher. As CEO, Paul is responsible for LucidWorks’ vision and success in the enterprise-wide search, discovery and analytics market. He comes to LucidWorks with 30 years of sales, marketing and business management experience within high-tech enterprise software. This episode gives you an inside look on what is coming in the near future, and what makes LucidWorks the hands down Experts in Enterprise Search. Paul touches on our recent announcements of our partnership with Hortonworks and we discuss Amazon switching to Solr. SolrCluster is hosted by: Yann Yu and Adam Johnson. Questions? email us at solrcluster@lucidworks.com or on twitter @LucidWorks #solrcluster.

There’s been a lot of big news coming out of Hortonworks this week, namely announcing their partnership with Lucidworks to bring Solr-powered search to their big data platform. This partnership makes Apache Solr the defacto big data search platform of choice for all Hortonworks customers. The combination of Apache Solr and Hortonworks Data Platform (HDP) makes big data accessible to more people within an organization, not just developers, analysts, and data scientists. The SolrCluster crew was lucky enough to catch up with David McJannet, Vice President of Marketing at Hortonworks, to chat about the announcement.

There’s been a lot of big news coming out of Hortonworks this week, namely announcing their partnership with LucidWorks to bring Solr-powered search to their big data platform. This partnership makes Apache Solr the defacto big data search platform of choice for all Hortonworks customers. The combination of Apache Solr and Hortonworks Data Platform (HDP) makes big data accessible to more people within an organization, not just developers, analysts and data scientists. The SolrCluster crew was lucky enough to catch up with David McJannet, Vice President of Marketing at Hortonworks, to chat about the announcement. SolrCluster is hosted by: Eric L. Mitchell, Yann Yu and Adam Johnson. Questions? email us at solrcluster@lucidworks.com or on twitter @LucidWorks #solrcluster