This job listing expired on Aug 19, 2021
Tweet

Gearbox Software is looking for a Senior Data Engineer to join the Spark team. Spark is a platform and online game engine supporting both internal and external titles. Come combine your love of data and games and influence data-driven decision making in design, development, and business.

Responsibilities:

  • Ensure the integrity of all aspects of the data pipeline, from ingestion to data warehousing.
  • Perform queries against terabytes of structured and unstructured data to facilitate requests from stakeholders.
  • Build queries and transformations to turn unstructured data into tables and views that data analysts can use.
  • Create and maintain ETL processes for multiple titles across multiple environments.
  • Maintain and upgrade our data pipeline, improving data orchestration and our ability to quickly onboard new titles.
  • Work with key stakeholders to ensure all telemetry and appropriate KPIs are tracked and delivered.
  • Look for ways to improve processes and find opportunities to add value to the data platform.
  • Be an advocate for data at the company.

Requirements:

  • Bachelor's degree in computer science, related field, or equivalent training and professional experience.
  • 6+ years of experience developing highly scalable backend systems.
  • 3+ years of experience building and maintaining big data pipelines.
  • Advanced SQL knowledge and experience working with columnar data stores like Snowflake or Redshift.
  • Extensive experience working with structured and unstructured data.
  • Experience with Amazon Web Services (AWS): Kinesis (or Kafka), S3, Lambda, Glue.
  • Experience with Python, Go, or Java.
  • Experience with Linux.
  • Familiarity with Tableau or similar products.
  • Excellent teamwork skills, flexibility, and ability to handle multiple tasks.
  • Ability to grow and foster relationships across various departments with various backgrounds.

Bonus Points for:

  • Master's Degree in mathematics, statistics, computer science, or a related quantitative discipline
  • Game industry experience.
  • Experience with tools like Hadoop, Spark.
  • Experience with stream-processing technologies.
  • Familiarity with Docker.
  • Familiarity with microservices.
  • Familiarity with Git and Terraform.