Senior Software Engineer, Data Processing & Retrieval (Remote - US)
Raleigh, NC /
Engineering & Data Science – Backend Engineering /
About the Role
The Data team at Lucidworks is responsible for building the services that ingest, parse, transform, and load data into Apache Solr using a purpose built scalable ETL system. Additionally, the team is responsible for efficiently querying and retrieving data from Solr through development and maintenance of a custom query language, as well as advanced search features such as query transformations through business rules manually added by users, as well as those generated by machine learning models.
This team moves fast, and because of this each individual engineer is committed to producing quality software through thorough quality assurance and review of our own code and that of our peers. Engineers within this team are expected to not just code in Java, but also to maintain and write integration tests in Python as well as the CI jobs required to run them.
We are looking for someone with a DevOps mindset coupled with a solid foundation in designing and building microservices. You will write RESTful services in Java with Spring Boot that interact with other microservices deployed in Kubernetes. In this role, you will design, architect, and code modular solutions to difficult problems in the information retrieval space.
You’re a seasoned, scrappy engineer who plays well with others and you care about the work, the team, and the customers. You are able to work collaboratively with a diverse community of personalities spread across multiple time zones, leveraging your excellent communication skills to make sure everyone is on the same page. You take your roadmap by the horns, always two steps ahead of your to-do list, and work efficiently on behalf of our customers.
Above all we’re looking for someone who is passionate about search and Lucene based systems, like Apache Solr or Elasticsearch in particular, and wants to bring that experience to the table as we build out back-end support for next-gen search functionality.
- Design, develop and maintain new search functionality in the Fusion platform
- Help develop and integrate a new robust Search DSL with the underlying Apache Solr platform
- Design, develop and improve public facing APIs and SDKs to interact with the Fusion platform
- Develop and maintain advanced query rewriting functionality
- Assist and advise other Fusion developers at Lucidworks looking to build performant integrations with Apache Solr
- Assist and mentor junior team members
- 5+ years experience working with large-scale distributed systems using Spring Boot, Git, Gradle, and Java
- 3+ years of experience using Lucene based technologies (Solr, elastic, etc)
- BS in computer science or other math-based science (or equivalent experience)
- Solid understanding of Kubernetes, Helm, and Docker
- Experience with GraalVM and related scripting languages preferred
- Experience with messaging systems such as Kafka and Apache Pulsar highly preferred
Please note that at this time Lucidworks is unable to sponsor US employment authorization (both new and transfer).
Lucidworks is leading digital transformation by fusing the power of search and artificial intelligence to create connected experiences for work, shopping, research and support.
Fusion is our cloud-native ML-powered search platform that integrates open-source projects Spark and Solr with our proprietary code for query intent prediction, low latency search, hyper-personalization and smart app creation. Our products include applications that run on the Fusion platform including Predictive Merchandiser, which helps ecommerce teams harness the power of ML to improve ecommerce conversion and Smart Answers, which enhances chatbots and virtual assistants with natural language processing and deep learning. We believe in building a team to deliver these products that make searching for insights a uniquely personal experience for a worldwide community of users.
Our roots are in Apache Solr, the global search standard used by 90 percent of U.S. Fortune 500 companies. Our team includes contributors and committers to Solr as well as some of the world's foremost machine learning innovators. We are trusted by the world's largest brands to deliver personalized digital experiences across many industries, including: insurance, banking, capital markets, manufacturing, media, oil & gas, retail, software, and telecommunications. Those customers include companies like: Aetna, Morgan Stanley, Reddit, Red Hat, Uber, Verizon, and Wells Fargo. We also serve government agencies in the civilian, defense and intelligence sectors, including the United States Federal Reserve and the U.S. Census Bureau.
Lucidworks believes in the power of diversity and inclusion to help us do our best work. We are an Equal Opportunity employer and welcome talent across a full range of backgrounds, orientation, origin, and identity in an inclusive and non-discriminatory way. Applicants receive consideration based on the relevant talents, skills, and experiences they offer to our company. Thank you for your interest and we look forward to learning more about you.