Logo of Huzzle

Home

Matches

Explore

Manage

Data Engineer

image

AbbVie

3d ago

  • Job
    Full-time
    Senior Level
  • Data
    IT & Cybersecurity
  • North Chicago

AI generated summary

  • You need a relevant bachelor’s degree and 5+ years or a master’s and 4+ years of experience, with skills in Dynatrace, Splunk, SQL, Pyspark, JavaScript, Postgres, Hive, Airflow, and API design.
  • You will design and deliver data engineering solutions, build infrastructure for ETL processes, maintain CI/CD pipelines, and monitor data systems while ensuring compliance with software development policies.

Requirements

  • Bachelors degree in relevant field and at least 5 years relevant experience OR Masters degree in relevant field and at least 4 years experience.
  • Must have experience with metrics and logging analytics using Dynatrace and Splunk
  • Must have experience with SQL, Pyspark, JavaScript,
  • Must have experience with Postgres, Hive, and Iceberg
  • Must have experience with Airflow and Modak Nabu
  • Must have experience with Cloudera Public Cloud architecture and API-based design architecture.
  • Experience working with Pharmaceutical R&D industry-centric datasets is preferred.

Responsibilities

  • Design and deliver various data engineering activities to enhance the data platform, including data warehousing, master data management, data cataloging, system integration, data streaming, data visualization, data analysis, and data ops.
  • Building required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS, Cloudera, Spark, python, Modak Nabu, and SQL technologies
  • Work with R&D/life science-centric datasets and utilize this knowledge to develop TL(Standard Datasets) and ATL (asset-specific datasets).
  • Maintain CI/CD Azure pipeline for production code deployment for Madak Nabu and Cloudera Public Cloud
  • Monitor, maintain, and debug Datahub Clusters, Virtual Warehouses, and ML Workspaces.
  • Develop the data processing engine framework using scala, Iceberg and Cloudera
  • Ensure compliance with applicable AbbVie software development lifecycle policies and procedures.

FAQs

What is AbbVie's mission?

AbbVie's mission is to discover and deliver innovative medicines and solutions that address serious health issues today and the medical challenges of tomorrow.

What is the primary role of a Data Engineer at AbbVie?

The primary role of a Data Engineer at AbbVie is to contribute to the architecture, design, and development of the Data & Analytics Platform that supports world-class research and development.

What technologies will I be working with as a Data Engineer?

You will be working with technologies including AWS, Cloudera, Spark, Python, Modak Nabu, SQL, R&D/life science-centric datasets, and more.

What is expected from a Data Engineer in terms of data engineering activities?

A Data Engineer is expected to design and deliver activities related to data warehousing, master data management, system integration, data streaming, data visualization, data analysis, and data ops.

What are the qualifications required for this position?

Candidates should have a Bachelor's degree with at least 5 years of relevant experience or a Master's degree with at least 4 years of experience in a relevant field.

Is experience in the pharmaceutical R&D industry preferred?

Yes, experience working with Pharmaceutical R&D industry-centric datasets is preferred.

What tools will I need to be familiar with for this job?

Familiarity with Cloudera Data Platform, Spark (Scala and PySpark), Airflow, Modak Nabu, Oracle, Postgres, Hive, and Iceberg is required.

Are there any specific metrics and logging analytics tools required for the role?

Yes, experience with Dynatrace and Splunk for metrics and logging analytics is required.

Will I be involved in maintaining CI/CD Azure pipelines?

Yes, maintaining CI/CD Azure pipelines for production code deployment is part of the responsibilities.

What type of company culture does AbbVie promote?

AbbVie promotes a culture of integrity, innovation, transformation, community service, and diversity and inclusion.

What benefits does AbbVie offer?

AbbVie offers a comprehensive package of benefits including paid time off, medical/dental/vision insurance, and a 401(k) plan.

Is AbbVie an equal opportunity employer?

Yes, AbbVie is an equal opportunity employer and is committed to employing qualified individuals without discrimination.

image

AbbVie

Science & Healthcare
Industry
10,001+
Employees

Mission & Purpose

AbbVie is a global biopharmaceutical company focused on creating medicines and solutions that put impact first — for patients, communities, and our world. We aim to address complex health issues and enhance people's lives through our core therapeutic areas: immunology, oncology, neuroscience, eye care, aesthetics and other areas of unmet need.