Visualization and process of data mining

The function of data processing is modularized, which greatly shortens the time for cleaning and organizing data;

Build a visual task flow by dragging and dropping to easily implement data operation logic;

The process can be reused when analysts trace back and verify logic;

Integrate more than 50 mainstream machine learning algorithms of 6 categories, and conduct real-time display of parameter adjustment evaluation;

Powerful user-defined integration module function, module reuse can directly play a role;

Build model intellectual property rights and comprehensively enhance the value of enterprise data assets;

Highly flexible and scalable system architecture

Support HDFS, S3, OSS and other distributed storage;

Alluxio distributed cache ensures high scalability of the whole system;

Distributed computing bottom layer based on SPARK, FLINK and MXNET;

Docker based underlying system architecture facilitates easy deployment and expansion;

Independent research and development of ACO scheduling layer, in-depth optimization of computing logic and resource allocation, and improvement of system performance;

Comprehensive big data management system

Unified management of files, databases and API data;

The data results can be displayed, exported and downloaded in charts;

Distributed storage greatly ensures data security and read/write efficiency;

Data governance, metadata management, data retrieval, permission management, etc;

There are multiple snapshot versions of each data, and the version can be selected for use or recovery at any time;

Efficient cross regional collaboration between teams

The roles and permissions of collaboration members can be defined. The permissions of personnel inside and outside the project are separated as follows:

Timed tasks and real-time message notifications can significantly reduce communication costs and achieve win-win cooperation;

The whole process visual data presentation and flexible data output enable analysts to focus on data applications;

Highly integrated functions of data application layer

Data mining results, one click data visualization through BI Factory components, and dynamic update of data sources;

Action Factory can easily connect data mining with the application system, so that the data results can directly serve the production system;

The data model can be separated from the function, docked with the existing system in API mode, and independently landed as an application product;

Multi directional data security

Encrypted storage of original files;

Encryption processing of communication between services to ensure transmission security;

Isolate the running environment of different users through the container;

The data cache adopts strict read and write permission control to isolate different user data;

Fine grained user permission control enables only authorized data and tasks to be accessed;

Amazon, Alibaba Cloud and other cloud security policies ensure secure encryption of cloud data;