Data Architect
Noida /
Product Development – Product Development /
Full-time
/ Remote
We are 3PILLAR GLOBAL
We build breakthrough software products that power digital businesses. We are an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. Our key differentiator is our Product Mindset. Our development teams focus on building for outcomes and all of our team members around the globe are trained on the Product Mindset’s core values – Minimize Time to Value, Solve For Need, and Excel at Change. Our teams apply this mindset to build digital products that are customer-facing and revenue-generating. Our business-minded approach to agile development ensures that we align to client goals from the earliest conceptual stages through market launch and beyond.
In 2023, 3Pillar Global India was named as a “Great Place to Work” for the fifth year in a row based on how our employees feel about our company, collaborative culture, and work/life balance - come join our growing team
Job Description:
We are looking for a Data Architect with 12 to 17 years of experience to be part of the product engineering team.
Responsibilities
- Assessments of existing data components, Performing POCs, Consulting with the stakeholders
- Proposing end-to-end solutions to an enterprise's data-specific business problems, and taking care of data collection, extraction, integration, cleansing, enriching, and data visualization
- Ability to design large data platforms to enable Data Engineers, Analysts & Scientists
- Strong exposure to different Data architectures, data lakes & data warehouses, and data hubs
- Define tools & technologies to develop automated data pipelines, write ETL processes, develop dashboards & report, and create insights
- Continually reassess the current state for alignment with architecture goals, best practices, and business needs
- DB modeling, deciding best data storage, creating data flow diagrams, maintaining related documentation
- Taking care of performance, reliability, reusability, resilience, scalability, security, privacy & data govenrance while designing a data architecture
- Apply or recommend best practices in architecture, coding, API integration, CI/CD pipelines
- Coordinate with data scientists, analysts, and other stakeholders for data-related needs
- Help the Data Science & Analytics Practice grow by mentoring junior Practice members, leading initiatives, leading Data Practice Offerings
- Provide thought leadership by representing the Practice / Organization on internal/external platforms
Requirements
- Must have:
- Strong Database & modelling concepts with exposure to SQL & NoSQL Databases
- Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warwhouse, data hubs, and other event-driven architectures
- Expertise in designing and writing ETL processes in Python / Java / Scala
- Understanding of Hadoop framework
- Exposure to PySpark, Spark, Storm
- Exposure to DataBricks and Snowflake
- Knowledge of Master Data management and related tools
- Strong exposure to data security and privacy regulations (GDPR, HIPAA) and best practices
- Skill in ensuring data accuracy, consistency, and quality
- AWS S3, Redshift, Lambda, DynamoDB, EMR, Glue, Lake formation, Athena, Quicksight, RDS, Kinesis, Managed Kafka ElasticSearch and ElasticCache, API Gateway, CloudWatch
- Ability to implement data validation processes and establish data quality standards
- Experience in Linux
- Proficiency in data visualization tools like Tableau, Power BI or similar to create meaningful insights from data
- AWS IOT,
- Apache NiFi, Talend, Informatica
- Azure cloud & its data services, Data Factory, Data Catalog
- Knowledge of GCP Data services - Exposure to AI / ML
- Experience with Talend
Nice to have
Benefits
- A competitive annual salary based on experience and market demands
- Flexi-timings
- Work From Anywhere
- Medical insurance with the option to purchase a premium plan or HSA option for your entire family
- Regular Health check-up camps arranged by the company
- Recreational activities (Pool, TT, Wii, PS2)
- Business casual atmosphere
- #LI-Remote
- #LI-DV
