Behaviour is looking for a talented Data Pipeline Developer who will be improving our data pipelines infrastructure to support an increasing volume of data and more frequent and in-depth queries. The chosen candidate will be responsible for the performance and reliability of the platform, will provide support to the analysts/scientists as well as ensure the quality of the data.

The Data Pipeline Developer we’re looking for must be a quick learner and love thinking outside the box. They must know how to organize workloads efficiently to balance live operations and development.

What will you do?

• Develop and maintain the current data pipelines to efficiently process over a billion lines of game data per day
• Develop and maintain the current ETLs to support the analysts, scientists and various automated processes
• Ensure the pipelines meet the needs of their different users
• Participate in the design of all new data-related solutions with other teams (data analysts, data scientists, software developers, cloud architects)
• Use best practices in testing, security, performance monitoring and effective use of resources
• Keep up to date with best practices, new services and implement them when appropriate
• Develop toolsets to manage and optimize the existing data pipeline operations

Qualifications

• Training in software development or related field
• At least 5 years designing and operating high volume data-related services
• Experience with SQL in querying large and complex data sets
• Professional experience with Python development or similar language
• Experience with system management (Linux)
• Excellent problem analysis and troubleshooting skills
• Good knowledge of standard data pipelines architectures and best practices

Assets

• Experience with cloud services (AWS or others)
• Experience with Container (Kubernetes)
• Experience with big data analytics tools (Spark, Databrick, Presto, Dask)
• Experience developing web APIs