Migrating processing from Cloudera to Teradata
Adapting PySpark processing for Teradata and integrating data from multiple sources.
- Python
- PySpark
- SQL
- Shell
Projects
Explore the business needs, my contributions and the technologies used during assignments at Dstny and through Apside. These case studies describe the work without disclosing internal data or confidential information.
Adapting PySpark processing for Teradata and integrating data from multiple sources.
Automating document collection, structuring content as JSON and experimenting with semantic comparison.
Integrating health and protection insurance data flows, automating processing and checking consistency.
Preparing and validating business data, creating Power BI reports and automating their delivery.
Adapting a rating model to technical constraints and exposing it through a web service.
Centralising data, generating PDFs and detecting data changes through checks and alerts.