Senior Data Specialist - R01553679
Edison, New Jersey, United States
Data and AI – Data and AI : Data Engineering /
Contingent Worker /
Remote
Senior Data Specialist
Primary Skills
- GCP (BigQuery, GCS, Pub/Sub, Cloud Run, Functions,Cloud SQL).
- Python & PySpark (Spark SQL)
- Airflow (or any orchestration tool
Job requirements
- GCP Data Engineer
- Strong with PySpark (esp. Spark SQL) for complex transformation pipelines
- Hands-on with Airflow for orchestration and BigQuery SQL for querying and data modeling
- Good experience in GCP (BigQuery, GCS, Pub/Sub, Cloud Run, Functions,Cloud SQL)
- Comfortable with real-time ingestion: Kafka, webhooks, file-based triggers
- Solid API integration skills (REST/webhooks), with ability to handle payload-driven workflows
- Experience working in Kubernetes (GKE) for deploying and scaling pipelines
- Comfortable handling UI-driven configuration, YAML-based setups, and modular frameworks
- Exposure to schema transformation, data validation, hashing, and DQF logic
- Domain familiarity with logistics/healthcare
- Strong ownership mindset — able to work under pressure and balance speed with reliability
- Basic understanding of BASH, SFTP transfers, Networking, Access Management
- Bonus: PostgreSQL, CI/CD, monitoring, dashboarding, or lightweight UI development
- =================================
- Python & PySpark (Spark SQL) – 3+ years
- Airflow (or any orchestration tool) – 2+ years
- Google Cloud Platform (BigQuery, GCS, Pub/Sub, Cloud Run, Functions, Cloud SQL) – 3+ years
- Real-time data ingestion (Kafka, webhooks, file-based) – 2+ years
- API integration (REST/webhooks) – 2+ years
- Kubernetes (GKE preferred) – 1–2 years
- BigQuery SQL & PostgreSQL – 2+ years
- YAML/config-driven pipeline design – 2+ years
- Schema transformation, hashing, DQF – 2+ years
- CI/CD, observability, lightweight dashboards (Grafana/Streamlit/Flask UI) – 1+ year
- Logistics or healthcare domain exposure – nice to have
Know more about:
Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/
Equal Employment Opportunity Declaration
Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.
#LI-SR1
