Data Engineer (Big Data Engineering)
Singapore, Singapore
Software Engineering – Software Development /
Full-time /
On-site
About CSIT
CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of use-cases, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented data engineers to build mission-critical products that identify, analyse, and investigate threats.
Role
As a data engineer in the Big Data Engineering team, you will contribute to the development of critical data ingest pipelines related to national security. You will be involved in complex projects to collect, parse, and process large datasets with the aim to turn them into useful information and insights for analysis.
Responsibilities
· Collaborate with key stakeholders to design and build scalable and maintainable solutions to ingest crucial data
· Work closely with the team to develop and optimise ETL data pipelines
· Ensure the smooth running of critical data pipelines and Big Data systems
· Be involved in technical discussions with the team and key stakeholders to solve Big Data problems
· Understand and identify technology and system pitfalls for the team
· Maximise technical delivery: setup, develop, build, test, and deploy
· Write clean code that the team adores
Requirements
Minimum qualifications
· Bachelor degree in Computer Science or equivalent
· Competent in programming languages such as Java or Python
· Familiar with agile development processes
· Able to communicate clearly
· Positive attitude and excellent teamwork
· Passionate and self-driven
Nice-to-haves
· Experience in one or more of the following technologies: Spark, Kafka, Hadoop, Nifi, Elastic Stack, Kudu
· Experience in DevOps
· Experience in one or more of the following areas: APIs, micro-services
· Experience in fullstack development (frontend, backend, DB, APIs)
Why join us?
· The work is purposeful and meaningful
· You will work with the best people
· We work with modern technologies and techstacks
· We have excellent engineering culture and work live balance
· We aspire for engineering and operational excellence
· We empower to innovate
· We grow together as a family
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
