Principal Software Developer - Big Data Platform 资深软件开发工程师 - 大数据平台

Beijing /
01. Engineering – Data Engineering /
Full time
We're looking for a principal software developer in data platform technology who is comfortable working with multiple languages, frameworks, platforms and excited to design and implement data platform to apply data pipeline to big data analytics, product decision, and business intelligence. As a senior software developer you’ll be responsible for architecture, development and implementation of data  platform, as well as data analytics tools. If you’re excited about learning about how to use data to power content discovery and personalization, to improve advertising and marketing campaign, and thus delight our users then this is likely the team for you. Here are a few of things that you’ll do:

Responsibility

    • Design and develop performant, highly available and distributed big data systems.
    • Own a platform, or two, by leading the architecture, development and maintenance.
    • Tackle design and architectural challenges such as performance, scalability, reusability and flexibility.
    • Advocate engineering best practices, including design patterns, code review and automated unit/functional testing.
    • Work with research teams to influence them on big data pipeline design, adoption and optimization.
    • Introduce the team to the value of new technologies and frameworks through experimentation and verification.
    • Help attract, recruit and develop the very best software engineer.

Qualifications

    • BS or MS degree in CS related major.
    • 5+ years of professional programming and design experience. Ability to be responsible for one domain independently.
    • Familiar with the Hadoop ecosystem, including Hadoop(MapReduce/YARN/HDFS), HBase, Hive, Spark, and customize at least one system at code-level. 3+ years of big data experience.
    • Good sense in employing open-source software code to solve practical problems.
    • Independent, energetic, highly technical, capable of driving for results under pressure and ambiguity and follow through
    • Strong communication, organization and planning skills.

职位描述:

    • 构建十亿用户量级的数据平台(10PB),完成日志采集、数据存储、数据仓库、数据服务、查询引擎的完整技术方案。针对营销、广告、推荐、BI等业务场景,提供不同的数据产品。同时随着数据量的不断攀升,以及业务场景的不断丰富,平台需不定期的升级,或引入新的技术方案。

职责:

    • 设计研发高性能、高可用的大数据产品,如近实时数据分析、在线数据服务、漏斗分析等 
    • 主导一到两个项目,完成从架构设计、开发、维护的工作 
    • 不断引入新的框架和技术,提升团队的技术能力 
    • 参与并引导团队做正确的事,包括合理的开发流程、良好的文档和编码习惯、技术选型等
    • 与算法团队合作进行大数据管道设计、采用和优化
    • 通过实验和验证向团队介绍新技术和框架的价值
    • 帮助吸引、招募和发展最优秀的软件工程师

要求:

    •  计算机相关专业的学士或者硕士
    • 5年以上大数据技术经验,具备独立负责一个技术方向的经验和能力 
    • 了解大数据行业的常见系统(Hadoop/Kafka/OLAP等),理解其原理并具有实际使用经验 
    • 较强的责任心、团队合作能力,主动性强,目标感强,能推动项目落地
    • 热爱工程师文化,热爱技术分享,良好的沟通能力