Data Engineer @ Scalac
Scalac Sp. z o.o. - Data Engineer
You write code :)
You cooperate closely with sales team, participating in tech talks with prospects as our Data Engineering consultant.
You are a consultant for customers. Help them to evaluate their problems, requirements, their architecture, engineering needs. You are a listener and a problem solver for them. You participate in meetings and estimations with clients.
You contribute to open source projects, write tutorials and blog posts.
You participate in conferences and meetups.
You are ready to be onsite in EU countries and in US/Canada for at least a week in a month.
Bring your own ideas - we’re waiting for passionate people!
What do we search for:
Programming experience in Data Engineering and distributed computing domain.
Experience in Scala or Python
Strong understanding of data processing and distributed computing concepts and technologies (being able to choose an optimum tech stack).
Experience in designing and implementing data processing architectures.
Experience in architecting and developing data pipelines and systems:- databases and FS (Cassandra, Hadoop, Redis, Postgres, MongoDb, SQL, S3, Aerospike),
- queues (RabbitMQ, Kafka, Kinesis),
- processing (Kafka, Flink, Spark, Hive, Processing),
- distributed / Big Data frameworks (Finagle, Akka, Data Science / ML, Zookeeper),
- data formats (Avro, ProtoBuf, Parquet),
- workflow managers (Luigi / Airflow).
Experience in growing and scaling technically project: from a single app with a proto-data pipeline to high load / availability systems, data lakes, etc.
Experience in consulting and applying different architectural patterns: event sourcing, streaming, microservices, etc.
Understanding of pros and cons of different cloud providers.
Knowledge of agile methodologies.
Experience with the design of applications for scale and load.
Experience in growing an internal expertise in data engineering and science.
High level of the self effectiveness.
Experience in being a consultant for customers.
Nice to have:
Experience with Machine Learning.
Great customers to work with (small, agile, startup-ish clients AND bigger well-respected ones, Western Europe companies).
Freedom (team decides) to choose conventions and work tools.
Best work equipment.
Opportunity for professional development (unlimited books budget, budget for trainings, opportunities to travel to technical conferences).
Regular company-wide retreats - we meet in person to work and play together.
100% remotely job.
Working with the international team.