Senior Data Engineer: Build Streaming Data at Scale with Modern Tech

The Senior Data Engineer opportunity at Movable Ink stands out for professionals passionate about working with advanced data streaming platforms and modern cloud infrastructure. This permanent role offers a competitive base salary of $145k CAD to $185k CAD, plus benefits and potential bonuses. The position targets experienced engineers with a strong background in Elixir, Python, streaming technologies, and analytical databases.

Key Responsibilities and Day-to-Day

In this role, you’ll design, build, and maintain high-scale event streaming pipelines. Data is ingested from multiple sources including client systems and third-party platforms. The job involves supporting analytical databases and making data accessible for low-latency querying, keeping performance as a top priority.

Daily tasks also include writing production code in Elixir and Python, orchestrating event processing and transformation jobs. Integrating legacy data pipelines with modern streaming solutions is a constant challenge, requiring both creativity and precision to minimize risks.

You’ll also develop and maintain monitoring and alerting systems to guarantee the health and freshness of data, and ensure service-level agreements are consistently met. This implies strong collaboration across engineering and analytics teams to define schemas and enforce data standards.

Your expertise will be vital in shaping architectural decisions and participating in code and design reviews. Best practices for data operations are highly valued here, providing ample opportunities to learn and grow in a dynamic environment.

Vorteile der Rolle

Joining a newly formed team, you get a ground-floor role in a core data domain of a thriving AI company. You’ll have the chance to set standards and truly own your projects.

The technical stack is both modern and robust, with technologies like Apache Flink, Kafka, Pulsar, Elixir, Python, and advanced OLAP databases. If you crave working at billions-event scale, this is for you.

Cons of the Role

Expect a fast-paced, demanding workplace with high expectations for pipeline reliability and uptime. The need for operational excellence and on-call troubleshooting can bring added pressure.

The technical challenges here are significant; not every candidate can seamlessly bridge legacy systems and cutting-edge streaming tech. Some may find the learning curve steep initially.

Urteil

If you have extensive data engineering expertise, thrive on ambitious, high-scale projects, and want to take ownership in a growing AI-driven company, this job is a golden opportunity. Embrace the pace, tackle streaming challenges, and level up your engineering career!