Release Notes

datasqill 4.2

September 22, 2025

h2
- Bug fix in special cases with triggers
- Added functionality to generate versioned table objects via SQL using procedure pr_sqdv_gen
GUI
backend
- Freemarker Template for creation for ExportTableScriptService Service
- Freemarker Template for sending mails from scheduler
datasqill triggers
- Use tv table if target is a vv view when doing vacuum
modules
- DsModRunShell:
  - Error if Loop Empty has been added
  - Allow access to source and target objects
- DsModTemplateSQL
  - Error if Loop Empty has been added
  - Sync Source to Target: Added property delete enabled and delete partition
  - Historize:
    - Subset Condition added
    - Assume always, that non PK columns can be null
- WriteExcel: Missing NUMERIC type added for numbers
- DsModWebServiceClient: Error if Loop Empty has been added
- DsModRemote: Error if Loop Empty has been added
- MetaData:
  - For varchar columns generate the size only if the column size is > 0
  - Added columns for displaying object names in lower case if possible

datasqill 4.1.2

April 22, 2025

GUI
- Bug fix when running an action

datasqill 4.1.1

March 26, 2025

backend:
- SQDV now fully supported for h2, oracle and postgres
- statementsIfNotExists can now be used in dsdb files to execute database statements if a specific object does not exist
GUI
- NullpointerException in actiondialog.ActionCTL fixed

datasqill 4.1.0

March 13, 2025

All:
- Initial implementation for using https
- Preparation for elimination of direct access to the repository database
- New proxy jdbc driver. Should be added to all repository connections: Use instead of
  
  SQTS_DB_0 jdbc:h2:...
  
  SQTS_DB_0 jdbc:dsproxy:h2:...
- Enhancement of postgres statistics to gather sdqv row counts
backend:
- Bug fix while handling decimals in mysql and sqlserver
- Detection if sqlserver is case sensitive or not
- New system property to disable the automatic scheduling: set de.softquadrat.datasqill.scheduler.enabled to false
- Dependencies for Vertica, OpenEdge and Snowflake Databases added
- Insert into Oracle database: Convert to Number if target column is number
modules:
- DsModRemote and DsModTemplate: If the action is empty and there is only one source database object, datasqill is generating a query which selects from the source all columns which are in source and target
- DsModWebServiceClient: New connection parameter loopDelay introduced
- DsModWebServiceClient: DELETE method added
- DsModLoadFlatFile: added new attribute "Line separator"
- DsModTemplate: Snowflake in history module added
- DsModWriteExcel: Date handling improved
- DsModTemplate: New Module sync from source to target to be used with trigger based history
GUI
- Connections
  - Default values for trigger are taken now by the corresponding connection type.
  - Statement sets can be added by GUI.
  - Most changes in connection tables are revertible before save.
  - Testing the connections to the database and the rest server is now done in one action with one button.
- Documentation
  - In read only mode only the rendered markdown is shown in the documentation pane.
  - External links in markdown web view open the browser.
- Action and Object Editor
  - New objects or actions get the name '-' avoiding empty names.
  - Adjust window size of an action to the size of the display.
  - New context menu entry for objects added: "Copy All SQL Scripts".
  - Moved Documentation of action in extra docu tab the attributes on action editor have more place.
- Left Tree
  - Sheets can be cloned now. 'name of original sheet + - COPY' is used as pre selection of the new name.
  - Refactoring and improvement of navigation functionality
  - Improvement of drag and drop on left tree. Transfer of drag item is not allowed to different environments.
  - Move of folder to its children is not allowed.
- Runs
  - Popover of showing run statistics on run items replaced by a tooltip.
- Batches
  - Filter of Batches now possible.
  - Improvement lazy loading of batch tree items.
  - Navigation to sheet from batch list.
  - Navigation to action from batch list.
- Bugs:
  - Canceling sheet export file chooser is not causing exceptions any more.
  - Wrong title of STDOUT/STDERR Dialog fixed.
  - Improvement and fixing of code related to escape key in several dialogs.
  - Multiple showing dialogs of the same exception avoided.
- General GUI Improvements
  - Application exit and restart can be enforced by user in case of unsaved changes.
  - "No" as default button on exit with unsaved changes."
  - Rework of startup communication and order for App and WorkbenchPreloader improved
  - The last visited directory by the file chooser is persisted in local preferences.
  - Long Error messages are shown in a lazy loaded scrollpane.
  - Info-Tooltip for run elements is now lazy loaded.
  - Ctrl/Shortcut-W-HotKey can be used for closing tabs.
  - F1-Hotkey opens https://docs.datasqill.de/en.
  - Show '..'-Button when the column in run monitoring table is too wide or too long.

datasqill 4.0.0

February 13, 2024

All:
- upgrade to java 17
backend:
- datasqill server is now based on SpringBoot. TOMEE is no longer required and can be uninstalled
- Error message can now be longer than 500 characters
- Log configuration moved from application.properties to datasqill.env
- deployment:
  - Fixed deletion of empty sheet during deployment
  - New option for the deployment to save the deployed Version not to the control table for versions
  - Use the newest version of deployed entity when updating the version table
  - Added functionality to use the deployment for own objects
modules:
- New module for call Salesforce Web Services (Sales cloud)
- DsModWriteExcel
  - limit the column size to 100 characters to avoid that the excel limit for column size is outside its bounds
- DsModSAP
  - added support for RFC_READ_TABLE without compression
- DsModTemplateSQL
  - History module supports now SQL Server
  - All templates of DsModTemplateSQL use now the quoted table and schema names
GUI:
- New Editor Monaco for action content and documentation
  - Syntax highlighting
  - Documentation in markdown
  - New Editor functions like mini map, zoom / font size, see more details on pages about the Monaco editor
- Documentation editor
  - Visualisation of rendered markdown
  - Live-Rendering of markdown during editing
  - Insert pictures into documentation

datasqill 3.5.8

February 5, 2023

modules: DsModRemote: bug fix for a close logic of dbWriter
GUI: bug fix for missing or wrong formatted Json config file as program argument

datasqill 3.5.7

January 16, 2023

modules: DsModWriteExcel: added new functionality to generate Excel without a template
GUI: bug fix for Windows path in logging properties file
GUI: additional logging properties introduced in local settings

datasqill 3.5.6

November 23, 2022

backend: for prepared statement use execute instead of executeUpdate
backend: bug fix of 3.5.5. Missing CAST added

datasqill 3.5.5

September 18, 2022

backend: added email notification(ERROR event), if a batch cannot be started
backend: preparation for h2 release 2.x
GUI: fixed the problem with enter key in text area

datasqill 3.5.4

July 31, 2022

backend: added action_id, action_name, module_name for default trigger variables
GUI: added copy Path to Sheet context menu
GUI: added copy path in action and copy fullname, copy select in object
GUI: NEW Batch overview Tab
GUI: changed Batch editor Tab layout
GUI: added edit information for Connection Tab

datasqill 3.5.3

March 09, 2022

GUI: Preparation for using a batch as a batch element

datasqill 3.5.2

February 10, 2022

backend / GUI: Preparation for h2 Version 2.1
backend / GUI: Preparation for java 17
modules: DsLoadFlatfile:
- archive processed files only
- added variable connection_id and target_connection_id for trigger
modules: DsModExecProcedure added variable connection_id and target_connection_id for trigger
modules: DsModWebServiceClient: added variable connection_id and target_connection_id for trigger
modules: DsModWriteExcel: added new functionality to replace / exchange a sheet in existing Excel
modules: DsModSendMail: corrected the senders domain address
modules: DsModRunShell: Added loop query to select parameters from database and run the script per returned row
scheduler: CPPS(Critical path based scheduling) algorithm added. Thanks to Sergey with his master thesis

backend: deploySheet.sh new option to deploy a sheet as new (duplicate the sheet and the content with get new IDs)

The used ids will be renumbered with numbers of the sequence of the target database.
--> Target must be the development database / environment, because the sequence for object-ids is needed
deploySheet.sh --option '{"validate":"true", "intoFolder":target-folder-id}' < sheet-file

GUI: Enable batches as batch element. Capturing not enabled
GUI: cancel confirmation dialogs: make them all ask the same question and act the same way
GUI: Settings/Connections completely reworked:
- new Statement set editor
- new Trigger editor for Database and Database Types
- edit items via popup window
GUI: Action editor added Trigger editor
GUI: In batch element editor set default priority to NULL
GUI: On sheet Tab added right mouse functionality "Go to path". Moves the focus in the navigation tree to the sheet
GUI: Added right click on database object to find usage of this object

datasqill 3.5.1

September 30, 2021

module: Trigger implemented in DsModExecProcedure, DsModSendMail and DsModWebServiceClient
module: DsModWriteExcel: add a validation for target and template directory
backend: simplified upgrade of datasqill versions

datasqill 3.5

June 16, 2021

backend: major rework of file system structure:
- directory structure modified. ~/apps removed
- all jar-files are placed in ~/lib
- all jdbc files in ~/lib/jdbc
- central setting of environment settings in bin/datasqill.env
- files like datasqill-server/conf/server.xml datasqill-server/bin/setenv.sh etc. are no longer customized
backend: New tables for module trigger. All database specific commands are now in this trigger tables (Concepts > Trigger)
scheduler:
- added partition dependency
- added functionality to have dependency of virtual objects between sheets. Added an attribute in sqts_object_type to enable this
- object type 1 (database table / view) and object type 2 (global virtual object) set to enable intersheet dependency
datasqill-api: renamed to datasqill-api.jar and includes required libraries in correct version
module: Java Module Interface simplified. All Java modules now use bin/runJavaModule.sh
module: Java Modules fire module trigger. Currently implemented in DsModTemplate and DsModRemote
module: DsModSendMail
- added attribute "Mail Body Mime Type"
module: DsModTemplate
- History module can now handle "ignore" and "inplace" columns
- History module now works with Oracle

datasqill 3.4.7

February 12, 2021

backend: Create unique typeNames for Oracle by adding current time in milliseconds
backend: Improved Logging on modulelibrary
backend: Bug Fix for write to SQTS_REQUEST_RESULT of long String(>4k)
backend: datasqillDBConnection:
- If supportsIdentifierCase is set to false in the connection all identifiers are used in lower case
- If the database does not support transactions, all transaction statements are ignored (commit, rollback, setAutoCommit)
- Error message if a key cannot be found with mappertool / getkey
backend: Singleton handling in ConnectionReader for testing purposes improved.
backend: Exception thrown instead of "false" return value on reading connection data by key.
backend: datasqillDBValidate use more often try with resource, do a rollback in exasol dependencies and use unique view names
backend: draft version for testing a connection are integrated into datasqill library
backend: mappertool:
- Command keyfile simplified and usage of GLOBAL_KEYFILE removed
- New order for specifying a keyfile. Environment Variable KEYFILE added for this purpose
module: DsModMetaData:
- Logging can now be set on module level for this module
- Improved exception handling for wrong DB
module: DsModWriteExcel:
- Bug Fix for suppressEmptySheet condition
- Bug Fix with templateRow (it was not possible to insert data into excel on first cell)
module: DsModTemplate:
- Make use of global variable to do some activity after writing into a table
- Bug Fix with time format of module_start-dates
- Logging improved in loops
module: DsModRemote: use several schemata from keyfile
module: DsModWebServiceClient:
- added set for custom RequestProperty
- Logging improved
module: First beta of history module for postgres and exasol

(Additional release notes 3.4.6 through 3.0 follow the same structure - see German version for full details)

datasqill 3.0

January 31, 2019

First complete Version with java FX and H2 experimental