DataGear data visualization analysis platform v5.1.0
5.1.0
DataGear is a data visualization analysis platform developed using Java language. It adopts browser/server architecture and supports multiple data sources such as SQL, CSV, Excel, HTTP interface, JSON, etc. Its main functions include data management, SQL workbench, and data import. /Export, data set management, chart management, Kanban management, etc.
1. Manageable database driver
Database drivers can be added through the driver management function to support connecting to new databases without restarting;
2. Data sets in multiple formats
Supports data sets in multiple formats such as SQL, CSV, Excel, HTTP interface, JSON, etc.;
3. Multi-dataset aggregation chart
Multiple data sets in different formats can be added to a chart to aggregate and display them;
4. Plug-in chart type
Each type of chart is provided in the form of a chart plug-in, and a large number of chart plug-ins are built-in. Administrators can also upload custom chart plug-ins to enrich the system chart types;
5. Freely editable HTML signage template
The Kanban board uses native HTML web pages as templates, which can be freely edited, bound, and asynchronously loaded with charts, and supports importing any HTML web page into a Kanban board;
6. Rich Kanban API
The Kanban page has a large number of page-side APIs built into it, which can be used to personalize and extend the Kanban function.
1.datagear-analysis
The underlying module of data analysis defines data sets, charts, and Kanban APIs
2.datagear-connection
Database connection support module, which defines APIs that can load JDBC drivers from specified directories and create new connections.
3. datagear-dataexchange
The data import/export underlying module defines the API for importing/exporting specified data source data.
4.datagear-management
System business service module, which defines service layer APIs for data sources, data analysis and other functions
5.datagear-meta
The underlying module of data source metainformation defines the API for parsing the structure of the specified data source table.
6.datagear-persistence
The underlying module of data source data management defines APIs for reading, editing, and querying data source table data.
7.datagear-util
System common toolset modules
8.datagear-web
System business web module, defining web controllers and operation pages
9.datagear-webapp
System Web Application Organization Module, which defines the structure for building a system into a standard WAR package
10.datagear-webappembd
System independent application organization module, which defines the structure for building the system into independent executable programs
rely
Java 8+
Servlet 3.0+
compile
(To perform unit test compilation, the unit test environment needs to be configured in advance)
mvn clean package
(No unit test compilation is performed, and there is no need to pre-configure the unit test environment)
mvn clean package -DskipTests
run
cd datagear-webappembd/target/datagear-[version]
(Linux environment)
./startup.sh
(windows environment)
startup.bat
debug
1. Import datagear into the IDE tool as a maven project;
2. Add datagear-webapp as a web application to the servlet container (such as Tomcat);
3. Run the Servlet container in debug mode.
Debugging Notes
Before debugging the development branch (dev-*), it is recommended to back up the DataGear working directory ([user home directory]/.datagear), because the DataGear working directory will be modified when the development branch program is started, which may cause previously used programs and subsequent The published program cannot start properly.
When debugging, the system will only upgrade the built-in database (Derby) when it is started for the first time. If you encounter a built-in database access exception, you need to check
datagear-management/src/main/resources/org/datagear/management/ddl/datagear.sql
file, find the SQL statement that needs to be updated, and manually update it to the built-in database.
The system comes with a simple tool class org.datagear.web.util.DerbySqlClient that can be used to execute SQL statements for the built-in database, which can be run directly in the IDE. Note: You need to stop the DataGear program before running it.
v3.2.0
New: Added scoring loop and stage dashboard to built-in charts;
New: Added destroy() and onDestroy() functions to the chart listener to handle chart destruction events;
New: "dg-dashboard-unimport" is added to the kanban element attribute to exclude the introduction of built-in kanban resources;
Newly added: Data management query conditions, data import/export, and SQL workbench have added SQL anti-injection configuration to enhance system security;
New: Added SQL anti-injection configuration to the SQL data set to enhance system security;
New: A verification code is required to log in, and the number of login attempts is limited to enhance system security;
New: Registration requires a verification code to enhance system security;
Fix: Fixed the bug that extra identifier quotes would be added in data export SQL;
Repair: Fixed a bug that caused the parent page to automatically refresh after clicking the [OK] button in the export page opened on the data table query page;
Improvement: Kanban supports introducing global resources in the form of "../global/*", making it easier for browsers to cache global resources across Kanban boards;
Improvement: The loadUnsolvedCharts() function of the Kanban JS object supports specifying the search root element;
Improvement: Built-in line charts, column charts, nested pie charts, and scatter charts have added [category] data markers to facilitate drawing single data set and multiple series charts;
Improvement: The built-in box plot, thematic river plot, and the pictogram column chart have added [category] data markers to facilitate the drawing of single data set and multiple series charts;
v3.0.0
Incompatible: Organize and merge the system database script datagear.sql, and do not support automatic upgrades below 2.13.0;
New: Added password setting function for sharing board. After setting, password confirmation is required to access the board;
New: The Kanban visual editing mode adds the function of editing the attributes of image/hyperlink/video/text label elements;
New: Added the function of inserting text labels in the Kanban visual editing mode;
New: The Kanban chart theme has new titleTheme and legendTheme attributes, and a new fontSize attribute for setting the font size;
New: Added [Variable Model] feature to the data set, and removed the required rules for data set attributes to support data sets with unfixed data structures;
Repair: Fixed the bug that unauthorized users can still open the link to display on the board;
Fix: Fixed a bug in which a value sequence would appear when there are cells with null values in the Excel data set;
Repair: Fixed the bug that the source code was not synchronized after switching to the source code mode after refreshing the Kanban visual editing mode;
Repair: Fixed the BUG that the element node path information was not reset after deleting elements in Kanban visual editing mode;
Repair: Fixed the bug of SQL automatic completion error when no data source is selected in the SQL data set;
Fix: Fixed the bug that the table width on the data source import/export data page was not filled;
Fix: Fixed the BUG that caused an error when saving when the new Kanban global resource storage path included a new directory;
Improvement: Add a quick execution button to the visual editing mode of the Kanban board. Click to directly execute the last operation;
Improvement: The operation of deleting elements/unbinding charts in Kanban visual editing mode requires confirmation for execution;
Improvement: Change the edit text field of the Kanban visual editing mode chart option to a formatted text editor;
Improvement: Kanban visual editing mode chart options support setting the chart option JS variable name;
Improvement: Kanban visual editing mode maintains element edge status after refreshing the page;
Improvement: Kanban source code editing mode supports code folding;
Improvement: The chart list panel on the Kanban editing page has been changed to be draggable;
Improvement: Custom charts are rendered by default as a data JSON string list instead of a table to avoid the problem of not being able to display complete data;
Improvement: System chart support library ECharts has been upgraded from 5.2.2 to 5.3.1;
