Big Data Engineer

Mountain View
R&D – Research
Employee
We are looking for a Big Data Engineer that will work on the storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Responsibilities

    • Selecting and integrating big data frameworks required to provide requested capabilities
    • Build analysis pipelines as well as visualization dashboards
    • Monitoring performance and iterate the solution fast

Skills and Qualifications

    • Proficiency with programming languages such as Python and Java
    • Proficient understanding of distributed computing principles
    • Proficiency with Hadoop v2, MapReduce, HDFS
    • Proficiency with Spark
    • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
    • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
    • Knowledge of various ETL techniques and frameworks, such as Flume
    • Experience with various messaging systems, such as Kafka