IT Jobs in Canada
Job Description
Live Assets | IT Staffing Solutions is hiring a Data Engineer for our Healthcare client. Apply now to work with cutting-edge technologies like Python, PySpark, and Apache Parquet, transforming data with precision and compliance.
Responsibilities
- Convert historical data from SAS database format to Parquet, ensuring data accuracy and integrity throughout the process.
- Collaborate closely with teams to re-code and transition existing production processes from SAS to Python, leveraging PySpark for data processing.
- Identify and recommend improvements and enhancements to data conversion processes and ongoing production of analytical assets to increase efficiency and data quality.
- Prepare documentation detailing the results of the conversion process, highlighting any differences in data that may impact analysts’ use of the data.
- Monitor project deliverables, timelines, and milestones. Identify, report, and assist in resolving potential risks and issues that may arise during the transformation project.
- Ensure all data conversion activities comply with Company Privacy and Security Policies and Procedures. Maintain data security and confidentiality throughout the migration.
Necessary Skills
- Proven experience in data conversion from SAS to Parquet or similar data format.
- Proficiency in Python and in big data technologies like Apache Spark, and Apache Parquet.
- Experience with PySpark for data processing.
- Strong understanding of data privacy and security regulations, particularly in healthcare or sensitive data environments.
- Experience in process improvement and optimization.
- Excellent project management skills with a track record of meeting deadlines and managing risks.
- Strong documentation and communication skills.
- Ability to work collaboratively in a team environment and provide coaching and mentoring to colleagues.
- Strong problem-solving skills and attention to detail.
About Live Assets | Leaders in IT Excellence | Greater Toronto Area
Live Assets is a premier IT agency dedicated to delivering excellence in tech solutions across various industries.
Our agency is renowned for its expertise in engineering, and we take pride in our track record of delivering outstanding IT projects with precision and innovation.
With a wide spectrum of clients spanning different industries, we cater to both permanent and contract IT opportunities.
Discover more about our agency and stay updated on our latest developments through our social media channels:
LinkedIn – Twitter – Facebook –Youtube – Glassdooor