Sr Data Engineer Lead

New York, New York /
Software Development /
Recognized as a top 10 finalist in Google's Machine Learning Competition and by industry as Decoded Fashions top start up, Trendalytics is working on the industry's most pertinent and cutting edge problems in predictive analytics. 

We are seeking a Sr Data Engineer Lead who will split time between hands on software development and managerial activities. You will own data environments, integrate with new technologies, and oversee the development of new processes. You will gather requirements through direct interaction with business, science, as well as software development teams. You will track the performance of our resources and related capabilities, constantly evolving our offering in order to scale our capability set with the growth of the business and needs of our clients: multiple Fortune 500 companies and disruptive online retailers.

Responsibilities

    • Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production
    • Experience mentoring and managing other Data Engineers, ensuring data engineering best practices are being followed
    • Design, implement and manage data pipelines at enterprise scale with unit testing, data migration and production data maintenance.
    • Use your expert coding skills across a number of languages like SQL, Python and Java to support analysts and data scientists
    • Design and develop new framework and automation tools to enable teams to consume and understand data faster. Enhance, refine and implement existing applications and systems.
    • Formulate and refine analytics algorithms leveraging data from search, social and e-commerce in time series, text and image-based formats.
    • Responsible for development, testing, documentation and analysis of modules or features of distributed software systems and products.
    • Develop accurate time, cost and resource estimates for developing and maintaining systems.

Qualifications

    • B.S. or MS degree in Computer Science or Computer Engineering, or related.
    • 5+ years of SQL (PostgreSQL, Oracle, AWS Redshift, Hive, etc) experience required, No-SQL experience is a plus.
    • 5+ years professional coding experience in Python, C/C++, Java or Go.
    • 5+ years professional experience with data warehousing, data architecture, ETL data pipeline and/or data engineering environments at enterprise scale.
    • Professional experience architecting and developing large scale cloud based distributed systems. Experience in concurrency, multithreading and synchronization.
    • Communication skills including the ability to identify and communicate data driven insights
Trendalytics is an equal opportunity and affirmative action employer. Individuals seeking employment at Trendalytics are considered without regards to race, sex, color, creed, religion, national origin, age, disability, genetics, marital status, pregnancy, unemployment status, sexual orientation, citizenship status or veteran status.