Develop a 'Mirroring' layer for FASE data: Use PyIceberg to land raw tables and views into an Iceberg catalog on the Lakehouse

[bashanlam]

• Automate Oracle Data Ingestion: Develop an automated DLT pipeline to synchronize Oracle source tables with a PyIceberg-managed data lakehouse, ensuring schema mapping and efficient data ingestion.
• Create scripts that queries views of Oracle schema, retrieves the underlying SQL, and saves the output as view in the dbt models.
• Developed a migration utility to map Oracle SYNONYMS to dbt-native resource.
• Automate Postgres Data Ingestion: Develop an automated DLT pipeline to synchronize PostgreSQL source tables with a PyIceberg-managed data lakehouse, ensuring schema mapping and efficient data ingestion.
• Create scripts that queries view of Postgres schema, retrieves the underlying SQL, and saves the output as view in the dbt models.