Senior Data Engineer in Toronto ON

Leave this field empty
The Judge Group logo
The Judge Group
Title: 
Senior Data Engineer
Date: 
02/09/2020
Job ID: 
647981
Location: 
Toronto ON
Degree: 
Not Specified
Salary: 
Open
Job Types:
IT Manager, Programmer, Web Development
Facebook
Google Plus
LinkedIn
Twitter

Our client is currently seeking a Senior Data Engineer

Here is the job description for your review:

Position Title: Senior Data Engineer

Duration: Full Time

Location: Toronto, ON

  • Client is seeking a Senior Data Engineer, to join our rapidly expanding IT Organization and assist us as we work to be a digital leader in our industries
  • Perform technical systems and data flow development in a variety of projects for complex front, middle and back office applications, with a focus on the reporting and analytics environment; this environment is built on a Microsoft Azure cloud and is underpinned by a Hortonworks Hadoop stack
  • Perform technical systems and data flow design for small-to-medium sized projects
  • Work with multiple project execution and deployment teams (e.g. Development Architecture, Release Management, Production Support)
  • Work closely with source system SMEs to produce source to target mappings
  • Translate business requirements to technical specifications
  • Work closely with the technical leads and architecture teams, and align solutions that meet the departmental architectural vision
  • Able to handle multiple priorities seamlessly

Requirements:

  • 8+ years of hands-on development experience in multiple projects, with progressively increasing responsibility
  • 5+ years of hands-on experience working with data warehousing like applications and big data.
  • Experience leveraging big data technologies (One or more of Hadoop, Python, Spark) is required.
  • Exposure to Microsoft Azure (or other cloud) platforms is preferred
  • Experience working with various data exchange formats (JSON, CSV, XML etc.)
  • Solid understanding of relational and dimensional database design and knowledge of logical and physical data models is preferred
  • Experience with SDLC and/or Agile methodologies for project development, and participation in all phases of project development, is required
  • Excellent knowledge of SQL and Linux shell scripting
  • Experience in deploying and managing SQL and NoSQL databases is preferred
  • Experience with job scheduling (TIDAL, CAWLA, Oozie) and file transfer (e.g. SFTP)
  • Excellent diagnostic, analytical and problem-solving skills are preferred
  • Experience with continuous delivery tools (Jenkins, Bamboo, Circle CI), and an understanding of the principles and pragmatics for build pipelines, artefact repositories, zero-downtime deployment, etc. is preferred
  • Experience building real-time data pipelines using Kafka or spark streaming is preferred

Apply Now
First Name
Last Name
Email
Name and email are optional and not part of your application. It will be used solely by CareersInFood.com to send you new job alerts.
Resume
Cover Letter
Send copy of my application to my email
Sign up for our newsletter
By continuing you agree to CareersInFood.com's Terms of Service