SAP Message Analysis

[kspeeckaert]

Hi,

I wanted to use this write-up to thank you for creating SQLPage 🙏.

I'm a data engineer professionally, and while I can develop, I really dislike having to fiddle with anything front-end related. I've had my eye on SQLPage for quite some time, but now that ODBC support has been added and I can connect it to DuckDB, it was time to get my hands dirty.

For one of my customers, we're processing quite a few SAP messages through a custom interface. Especially when onboarding a new plant, but also while investigating issues, it's necessary to analyse and validate a batch of messages. Before, I had SQL statements prepared that I would run when needed, but using SQLPage, I've been able to replace those and add additional insights.

The backend is DuckDB, and the messages are first converted from XML to JSON and flattened (necessary because the schema is quite volatile), then loaded into DuckDB at which point I can run SQLPage to analyse them. The connection is R/O, which means that I can further analyse using e.g. DBeaver for more specific insights.

The screenshots only show the pages for one process, but it's basically rinse and repeat for the other two.

The validation page generates SQL statements that can be used to validate the incoming data with our production database.

I did a few customisations to the templates:

• The code template has been extended so that a copy button is added to the upper right corner. This uses ClipboardJS. It works if the code component is on a page by itself, I haven't managed to get it to work in an embedded modal (because the modal contents are injected after the ClipboardJS initialisation runs). I also added the user-select-all class to the code, so clicking anywhere in the code text will automatically select all text, again for ease of copying (I did this before implementing the ClipboardJS solution, but decided to leave it in).
• The columns template has been modified to allow the images at the top. I noticed this was possible when exploring the Tabler site, and the change was straightforward.

Note: The screenshots below have been redacted as this is customer data which I cannot share.

Page	Screenshot
Main page
Overview
Planning
Validation