Data Engineering

Job Description

Role Purpose:

The role involves designing and implementing robust data ingestion pipelines, enable SAS Viya Fraud, Waste, and Abuse (FWA) data models, and optimize large-scale data workloads in Google BigQuery. The ideal candidates will have strong experience in ETL/ELT development using Informatica IDMC, cloud data platforms, and healthcare data models.

Key Accountabilities:

1- Enterprise Data Ingestion and Data Engineering;

• Build reusable, parameterized mappings/taskflows.
• Implement CDC, idempotent loads, schema evolution, DQ gates.
• Optimize BigQuery loads (partition/cluster, load vs. stream).
• Set up version control and CI/CD.

2- Data Mapping & Transformation Design;

• Profile sources; define field-level mappings and rules.
• Specify business logic, joins, lookups, derivations.
• Define DQ rules, exceptions, and rejects.

3- Orchestration, Automation & Reliability Engineering;

• Parameterize taskflows; set schedules/dependencies.
• Implement retries/backoff and checkpointing.
• Integrate monitoring/alerts (Ops console, ChatOps).

4- Data Roles and Privacy management;

• Define least‑privilege IAM and service accounts.
• Apply dataset/table/row/column security & masking.
• Enable audit logs and retention; classify PHI/PII.

5- SAS Viya FWA Domain Modeling & Curation;

• Gather model inputs, features, windows, granularity.
• Align scoring logic and feature engineering steps.
• Design curated FWA datasets (claims, eligibility, providers, members, preauths).

6- Workload Monitoring, Performance & Cost Optimization;

• Track freshness, job health, volumes, anomalies.
• Monitor SLAs (duration, errors, cost/TB, slots).
• Tune BigQuery.
• Optimize cost (storage lifecycle, query tuning, caching).

Skills

• Data Engineering Tools: Informatica IDMC, Airflow, Apache Spark.
• Programming Languages: SQL, Python.
• Analytics Platforms: SAS Viya, SAS Enterprise Guide.
• Cloud Technologies: Google Cloud Platform (BigQuery, IAM), Azure/AWS (optional).
• Visualization Tools: Power BI, Tableau.
• Strong in BigQuery (SQL, modeling, tuning).
• Proficient with Informatica IDMC/IICS ETL/ELT.
• Experience with enterprise pipelines.
• SAS Viya (FWA) exposure is a plus.
• Knowledge of healthcare data (claims, providers, members).
• Understanding of cloud security (IAM, service accounts, private endpoints).

Education

Bachelor’s degree in Computer Science, Information Technology, Information Systems, or a related