Data Engineer (Remote)
San Antonio, TX
VivSoft Project – Information Technology Services /
Full-Time Remote /
Remote
About the company:
VivSoft is an emerging technology company that specializes in using modern technologies to solve our clients' toughest mission challenges. We are focused on Cloud, Enterprise DevSecOps, Artificial Intelligence, and Digital Customer Experience to drive mission-enabling digital transformation. Our passion is building mission-focused, open, scalable solutions. We are a diverse team of strategists, engineers, designers, and creators experienced in building high-performance software and AI factory accelerators by embracing.
About the role:
We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining the data infrastructure and pipelines that drive efficient data processes across our organization. If you are passionate about data engineering, thrive in a collaborative environment, and want to contribute to building robust data solutions, we want to hear from you.
Responsibilities:
- Design, implement, and maintain data infrastructure and pipelines for efficient data ingestion, profiling, conformance, ETL, analytics, cleansing, classification, visualization, and machine learning.
- Collaborate with data scientists, DevSecOps teams, and software engineers to integrate data solutions across environments.
- Implement automation for data extraction, transformation, and loading (ETL) processes.
- Collect data provenance and integrity requirements from government stakeholders
- Decompose requirements into technical development requirements that can be executed
- Proficiency with Kubernetes or Terraform for infrastructure management and automation.
- Work collaboratively with cross-functional teams to understand data requirements and deliver high-quality solutions.
- Utilize your problem-solving skills to design scalable and efficient data pipelines.
- Stay abreast of industry trends and best practices in data engineering.
Skills/Qualifications:
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- Proven hands-on experience as a Data Engineer, with a strong portfolio of successful data solutions.
- Proficiency in Python and other programming languages for data manipulation and analysis.
- Strong knowledge and experience with libraries such as Pandas, Numpy, and Scikit Learn.
- Solid understanding of databases, including PostGres, SQLServer, MySQL, Oracle, and proficiency in writing efficient SQL queries.
- Familiarity with cloud platforms such as AWS, Azure, Google Cloud, and their data services.
- Experience working with big data technologies like Spark and Hadoop.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
- Secret Clearance is required
