Data Engineering Jobs in Canada
Job Description
Live Assets | IT Staffing Solutions is hiring a Data Engineer for our Healthcare client.
Key Responsibilities
- Convert historical data from SAS database format to Parquet, ensuring data accuracy and integrity throughout the process.
- Collaborate closely with teams to re-code and transition existing production processes from SAS to Python, leveraging PySpark for data processing.
- Identify and recommend improvements and enhancements to data conversion processes and ongoing production of analytical assets to increase efficiency and data quality.
- Prepare documentation detailing the results of the conversion process, highlighting any differences in data that may impact analysts’ use of the data.
- Monitor project deliverables, timelines, and milestones. Identify, report, and assist in resolving potential risks and issues that may arise during the transformation project.
- Ensure that all data conversion activities comply with Company Privacy and Security Policies and Procedures. Maintain data security and confidentiality throughout the migration.
Necessary Skills
- Proven experience in data conversion from SAS to Parquet or similar data format.
- Proficiency in Python and experience with PySpark for data processing.
- Strong understanding of data privacy and security regulations, particularly in healthcare or sensitive data environments.
- Experience in process improvement and optimization.
- Excellent project management skills with a track record of meeting deadlines and managing risks.
- Strong documentation and communication skills.
- Ability to work collaboratively in a team environment and provide coaching and mentoring to colleagues.
- Strong problem-solving skills and attention to detail.
The Best IT Recruitment Agency in Toronto | About Live Assets | IT Staffing Solutions
Live Assets is a boutique IT Staffing/Recruiting firm specializing exclusively in building IT teams of excellence for the Information Technology sector.
We are a small, but productive team that works closely together and has had a 96% success rate for the past number of years!
We have a diverse number of clients and industries and focus on both full-time and contract I.T. opportunities.
You can find out more about our company on LinkedIn – Twitter – Facebook –Youtube – Glassdooor