Real time calculation Flink version
Play video
The real-time computing Flink version is a fully hosted serverless Flink cloud service provided by Alibaba Cloud. It has full lifecycle capabilities such as job development, data debugging, operation and monitoring, automatic tuning, and intelligent diagnosis of real-time applications. The kernel engine is 100% compatible with Apache Flink, with twice the performance improvement. It has enterprise class value-added functions such as FlinkCDC and dynamic CEP, and has built-in rich upstream and downstream connectors to help enterprises build efficient, stable and powerful real-time data applications.

Product specification

Provide a fully hosted Flink cluster and engine to improve the efficiency of job development, operation and maintenance.
Package capacity specification
3000CUH
Package Type
China Mainland Public Cloud General
term of validity
Please use it up within 3 months, and it will be invalid after expiration
Limited to 1 piece
Enquiry in progress
85% discount over March Take 10CU as an example
region
North China 2 (Beijing)
computing resource
ten
Purchase duration
3 months
Enquiry in progress

Product Functions

Real time data warehouse Assist enterprises to establish a digital operation system, make real-time statistics of key business indicators, visually present the production and operation of enterprises, and provide real-time data support for business decisions
Real time ETL Built in integration of dozens of connectors, covering database, message queue, OLAP engine and other systems. Self written SQL uses full hosting services to integrate real-time data flow and help enterprises build data middle ground
Real time risk control Real time identification of business risks such as scalping, cheating, malicious crawlers, etc. from massive data to avoid huge economic losses for enterprises. It can also use CEP (Complex Event Processing) to directly detect abnormalities in streaming jobs
Real time monitoring Real time computing Flink version's efficient status management, rich window support and other features can help enterprises simplify the rule alarm configuration process, improve the alarm effect, and reduce the cost of monitoring platform maintenance
Real time recommendation Real time analysis of user behavior, combined with AI technology to establish more accurate user profiles, and timely recommend more suitable news, videos and goods to users
Real time IoT data analysis Capture and analyze the huge amount of data generated by IoT equipment in real time, help users to analyze and diagnose the operating condition of equipment in real time, detect operating faults in real time, and predict the yield of products in real time

Product advantages

Full custody Flink service
Out of the box
Full cycle of development, operation and maintenance
Flexible billing
Rich enterprise level capabilities
One stop development, operation and maintenance platform integrating streaming and batch
Flink CDC real-time warehousing
Dynamic CEP helps real-time risk control/marketing
Automatic job tuning, making full use of resources, intelligent diagnosis and rapid positioning
Support text chain
Strong performance
Kernel engine optimization: CPU has hundreds of thousands of records per second
The test performance of Nexmark is 200% higher than that of open source
State storage backend optimization
100% compatible with open source
100% compatible with Apache Flink
Support open source Flink smooth migration to the cloud
Seamless connection with mainstream open source big data ecology
Support text chain
Open and integrated
Custom connector, UXF capability extension
Open API helps users integrate their own systems
User development capability expansion and precipitation reuse
User's own system integration
Industry recognition
Authoritative certification of China Academy of Information and Communication
The only real-time stream computing product in China entering the Forrester quadrant
Financial real-time digital warehouse scheme was shortlisted in the typical directory of information innovation of the Ministry of Industry and Information Technology

Function comparison

type
Performance and cost
Characteristic ability
Development efficiency
Mocha ITOM
Enterprise security
function
Elastic expansion and contraction
Payment type
Core performance improvement
Real time data warehousing into the lake
Real time risk control scenario capability
Upstream and downstream data connection (Connector)
Activity development
Code debugging
Monitoring alarm
Problem analysis and diagnosis
High availability guarantee
State management
Space isolation
access control
describe
Users can flexibly expand and shrink the capacity according to the service load
Intelligent tuning, unattended automatic monitoring and adjustment of job resource allocation
The corresponding resource plan can be applied in the specified time period to cut the peak and fill the valley, saving costs
Fine grained resources can be used to support refined resource allocation at the operator level
Utilization rate of large-scale operation resources increased by 100%
Users can choose monthly subscription or pay as you go according to their own business characteristics
The test performance of the Nexmark stream computing standard is 2-3 times that of the open source Flink
Support whole database synchronization and sub database and sub table synchronization
Support table structure change synchronization, full read slave database incremental read master integration
Continuous production capability: enterprise CEP supports dynamic configurable rules for non-stop operations
Seamless integration with Alibaba Cloud mainstream data products
Support the test data of special data simulation connector close to business meaning
Improved connector usability and stability
Customized registration connector can be used to connect various external storage systems
One stop development and management platform, including SQL/Java/Scala/Python
Support mainstream Flink versions, including multi version job code comparison and rollback
Built in unified metadata management, and can seamlessly interface with external metadata systems
Built in multiple domain function libraries, and functions can be customized as required
Provide templates for more than 20 common Flink SQL scenarios
Support online sampling and simulation test data management
Second level start and stop of jobs based on session cluster
Support intermediate results display to improve the debugging efficiency of complex SQL
Development and production isolation: the development and debugging process does not affect production operations and data
Rich indicator monitoring and dimension aggregation
Through nailing, email, SMS, telephone, timely alarm
It can be connected to the enterprise's internal unified monitoring and alarm system (prometheus)
Dynamically modify the configuration of the job, and adjust the configuration online without starting or stopping
Provide metadata management
Provide intelligent diagnosis and fast log location analysis for common problems
Give tuning or modification suggestions for common problems
Linkage automatic tuning capability helps users locate problems
Operation and maintenance services of the original factory are fully covered, and the SLA is 99.9% guaranteed
Full link automatic fault tolerance, supporting JobManager fault tolerance
Provide single point fast fault tolerance, flexibly balance data consistency and availability
Provide complete system checkpoint and job snapshot lifecycle management
Provide status compatibility check and status data migration
Support tenant level and project level resource and code isolation to meet cross team collaboration requirements
Connect with Alibaba Cloud account system and support multi role access control
Real time calculation Flink version (out of the box)
Initial purchase of new users 0 ¥
Open source Apache Flink

Industry solutions

E-commerce industry
Game industry
Financial industry
Advertising industry
Internet transactions
With the rapid development of the domestic e-commerce industry, the original "wide range" and "wide spread" operation mode can no longer meet the business needs. Through real-time computing, we can quickly mine user characteristics, analyze demand preferences, and help e-commerce enterprises complete the transformation of digital, refined, and personalized operations.
Capable of providing
Real time user profile
Develop real-time, efficient and personalized recommendations for different types of customers to improve the conversion rate of orders
Real time association recommendation
Establish real-time correlation analysis after customers purchase information to improve the probability of second purchase
Recommended combination
Game industry
As an emerging entertainment industry, the game's ability to attract money and interest has attracted more enterprises and talents to invest in it. With the rise of app stores and social networks, the scale of the game market has expanded unprecedentedly. Big data and AI have played an increasingly significant role in game operations, especially in extending the life of games.
Capable of providing
Forum data tracking
According to the communication and control of the player forum, access to the current player's core concern information and game bug detection to ensure the fairness of the game
Operation data control
Through real-time computing technology, conduct real-time analysis on game operation activities to obtain the most effective user transformation channel and improve the operation and promotion effect
Behavior data analysis
Establish player user profiles based on real-time behavior data analysis of players, customize different game benefit modes, and improve player retention rate and conversion rate
Recommended combination
Financial industry
In recent years, with the rapid development of the Internet financial industry, the combination of various businesses of traditional financial institutions (such as exchanges, securities companies, banks, etc.) with the Internet has become increasingly close. Provide overall solutions for the demand link, risk control, credit assessment, fraud risk, data quality and other needs of banking business. Take financial institutions as an example, build real-time data warehouse and anti fraud system through real-time computing Flink version, and help financial institutions quickly build real-time risk control system.
Capable of providing
Fraud detection
Real time monitoring and differentiation shall be carried out for user accounts and transaction behaviors to quickly identify transaction information and reduce user losses;
Real time risk control
Optimize the traditional risk control system through real-time calculation of Flink version, transform intelligent risk control, and improve the overall identification efficiency to apply multiple scenarios;
Credit evaluation
Quickly identify malicious fraud such as false data and information counterfeiting, identify high-risk groups, and shorten the audit process through intelligent ways;
Recommended combination
Advertising industry
The development of mobile Internet has gradually reduced the threshold and cost of obtaining information services, and also made users' information consumption more frequent and diversified. The overall growth rate of the mobile network news industry market is fast, and the development potential is huge. With the substantial growth of mobile traffic, the number of mobile news information users increases, and the differentiation is significant. The refined operation will be the main theme in the future.
Capable of providing
Massive data processing
Use powerful data processing capability to cope with the growing data volume (the number of users of the platform, daily average UV/PV and other core indicators), and improve business efficiency.
Standardization of complex scenes
Mainstream media, such as news, short video, live broadcast and other output methods, establish standardized and universal scenarios, and make business management and control faster.
Fast real-time business output
According to the personalized business needs of the content sharing platform, the business is refined through real-time computing to increase user stickiness and consumption desire.

Industry value

Internet entertainment enterprises
Real time content hotspot analysis, real-time user behavior analysis, real-time monitoring and analysis of user growth and activity, real-time recommendation of article videos, real-time advertising, real-time traffic operation, etc. are carried out through real-time computing Flink.
Online education enterprises
By using Alibaba Cloud's real-time computing Flink version, you can effectively solve the real-time/accuracy problems of computing in key online education scenarios such as continued reporting, resumption of classes, and live video quality monitoring. The complete streaming SQL capability provided by the product can greatly reduce the cost of business access and development. At the same time, the automatic elastic expansion and contraction capability of the product can effectively cope with traffic peaks and better meet the needs of complex and changing scenarios.
Online trading enterprises
By using Alibaba Cloud real-time computing Flink products, users can build the entire real-time recommendation system to improve the retention rate and conversion rate; At the same time, the landing of a large number of labels and customer portraits also enables the operation team to conduct more accurate targeted promotion for customers, significantly improving the conversion rate of promotion content.
Financial enterprises
Real time computing Flink version is used to build a real-time digital warehouse and real-time anti fraud system, helping financial institutions quickly build a real-time risk control system. The main business scenarios include real-time anti fraud, real-time large screen, real-time accurate push, etc.

Customer Stories

Aunt Qian
The risk control business architecture of Qian Dama is mainly composed of four parts: event access, risk response, risk perception, and risk backtracking. Alibaba Cloud real-time computing Flink version product online ETL processes real-time user profile tags and sales fact indicators, providing important data source support for the event access of Qian Dama's real-time rule engine. The risk control technology scheme has been applied to the business of Qian Dama Group to accurately identify the risk points of marketing activities and protect the interests of users.
Yicang Technology
ECom Technology is committed to building an intelligent and collaborative cross-border network. At present, tenants are distributed around the world, and the data comes from all continents. It collects sales data from all sites of major overseas e-commerce platforms. Faced with such a large data volume and complex scenarios across all regions of the world, the big data team of E-warehouse uses the ability of real-time computing Flink version of the high concurrency pipeline to process data and achieve accurate millisecond level synchronous warehousing of data.
Jiangling Motors
As a top 20 automobile manufacturer in China and one of the Fortune 500 Chinese enterprises, Jiangling Automobile Co., Ltd. has chosen to cooperate with Alibaba Cloud in big data construction. Through Alibaba Cloud real-time computing platform, it has built a unified real-time computing center for the company, serving multiple real-time scenarios of three business lines, namely, vehicle center, smart fleet, and real-time big screen, It realized the second level response of real-time business, and successfully helped the business department to improve the decision-making efficiency.
Chanjet
Changjietong's "Easy Accounting", as an accounting tool for the integration of industry, finance and tax, requires the administrator to query the statistical summary information of the tax declaration and voucher carry forward of the enterprise under his jurisdiction in real time. After using the real-time computing Flink version of the product, every tax declaration and carry forward is pre calculated in memory, and the query results can be displayed in real time in front of users, which greatly improves the response speed and user experience.
Two-dimensional fire
2D Fire focuses on the R&D and application of cloud computing catering software system. Its big data team realized high concurrency and second level analysis and processing of 10 billion level data through Alibaba Cloud real-time computing Flink+Hologres, and provided customers with more than 80 different types of reports, including business, order, dishes, members and other reports, providing multi-dimensional analysis perspective and business exploration for store development.
Weimiao
Through real-time calculation of Flink products, Weimiao has built a perfect real-time digital warehouse storage system to support businesses such as real-time monitoring of live broadcast indicators, improvement of class arrival rate, real-time monitoring of landing page access, effectively improving the class arrival rate by 10.5%, renewal rate by 1.5%, and stably supporting business needs.
Palm Reading Technology
Palm Reading Technology focuses on digital reading and is one of the world's leading digital reading platforms. Massive users based on the digital reading platform will build data infrastructure platforms such as commercialization, user growth, and recommendation services through Alibaba Cloud real-time computing Flink and other big data computing and analysis services to achieve the combination of commercial value-added and user reading experience.
Flying crane
Feihe is one of the earliest milk powder enterprises in China. It has a forward-looking vision to layout exclusive industrial clusters and control the whole process of milk powder production. With the help of real-time computing Flink and other products, Feihe builds a digital operation management system, establishes a real-time early warning mechanism, spies on risks in advance, and improves the effectiveness of supply chain and other business decisions.

Product Dynamics

2016-11-15 New functions/specifications
Stream computing supports log service read/write function
View details
2016-12-15 New Features/Specifications
Stream computing supports RDS table dimension function online
View details
2016-12-15 New Features/Specifications
Stream computing supports the display of performance and resource indicators of job dimension CPU and MEM dimensions
View details
2016-12-15 New Features/Specifications
Flow computing provides multiple underlying component operation indicators
View details
2016-12-15 New Features/Specifications
Stream computing supports cloud monitoring alarm
View details
2016-12-15 New Features/Specifications
Stream computing supports DRDS as dimension table and result table
View details
2016-12-15 New Features/Specifications
Stream computing bottom layer supports more system built-in functions
View details
New functions/specifications on February 28, 2017
Stream computing adds MQ type data source support
View details
New functions/specifications on February 28, 2017
Stream computing supports multiple operation and maintenance indicators online
View details
2017-04-19 New functions/specifications
Support MaxCompute as input dimension table
View details
2017-04-20 New functions/specifications
Stream computing supports Redis as a write in plug-in
View details
New products on March 31, 2018
Alibaba Cloud streaming computing - commercial release
View details
2018-05-05 Price adjustment
Annual discount of Alibaba Cloud streaming computing package
View details
2018-05-10 New Features/Specifications
AliCloud streaming computing online configuration reduction
View details
2018-05-25 New Features/Specifications
The start of flow calculation is adjusted to 2CU
View details
2018-06-07 New functions/specifications
Stream computing exclusive mode test invitation
View details
2018-06-28 New Features/Specifications
AliCloud streaming computing supports more data storage
View details
2018-07-05 New functions/specifications
Stream computing CEP function goes online
View details
2018-08-08 Function optimization
View details
2019-01-31 New Region/New Availability Zone
Online Malaysia, Hong Kong
View details
2019-09-30 New Region/New Availability Zone
Real time calculation, service opening in Singapore, 2019.2
View details
2020-08-20 New Features/Specifications
Flink full hosting supports pay as you go mode
View details
2020-08-21 New Features/Specifications
Flink full hosting version 2.2.0 officially released
View details
2020-09-15 New Features/Specifications
Commercial release of Flink fully hosted version
View details
2020-09-22 New Features/Specifications
Real time computing Flink fully hosted version supports CDC function
View details
2021-01-11 New Features/Specifications
Real time computing Flink version supports intelligent diagnosis
View details
2021-03-16 New Features/Specifications
Real time computing Flink development console interface updated
View details
2021-04-19 New Features/Specifications
Real time calculation Flink 2.4.1 release
View details
2021-08-04 New Features/Specifications
Real time calculation Flink SQL job supports the configuration of fine-grained resources
View details
2021-08-04 New Features/Specifications
Real time calculation Flink 2.5.7 release
View details
2021-12-16 New Features/Specifications
Real time calculation Flink version 2.8.0 released
View details
2022-03-04 New Features/Specifications
New version of real-time computing Flink released
View details
2022-04-20 New Features/Specifications
Support Lindom dimension table and result table
View details
2022-05-16 New Features/Specifications
4.0.13 Release
View details
2022-05-16 New Features/Specifications
New support for Kafka Catalog
View details
2022-05-16 New Features/Specifications
CDAS new sub database synchronization capability
View details
2022-05-16 New Features/Specifications
Hologres Connector supports consumption of full incremental all-in-one source tables
View details
2022-05-16 New Features/Specifications
Redis result table supports Key TTL
View details
2022-05-16 New Features/Specifications
MaxCompute Connector supports Stream Tunnel
View details
2022-05-16 New Features/Specifications
Hologres Connector supports Datastream API
View details
2022-05-16 New Features/Specifications
Elasticsearch Connector supports retry_on_secure parameter
View details
2022-05-16 New Features/Specifications
MySQL CDC related upgrades
View details
2022-05-16 New Features/Specifications
Session cluster enhances stopping capability
View details
2022-05-16 New Features/Specifications
Intelligent analysis of JM exceptions
View details
2022-05-16 New Features/Specifications
Built in AliCloud documents
View details
2022-08-18 New Features/Specifications
Ability to provide file system result table
View details
2022-08-18 Function optimization
Optimize MaxCompute write performance
View details
2022-09-19 New Features/Specifications
State Set Management
View details
2022-09-19 New Features/Specifications
Timing tuning
View details
2022-09-19 New Features/Specifications
Job health score
View details
2022-09-19 New Features/Specifications
New function OpenAPI goes online
View details
2022-09-19 New Features/Specifications
Member authorization optimization
View details
2022-09-19 New Features/Specifications
Support dynamic complex event processing (CEP)
View details
2022-09-19 New Features/Specifications
Static CEP SQL enhancements
View details
2022-09-19 New Features/Specifications
Provide fast recovery capability in case of job failure switching
View details
2022-09-19 New Features/Specifications
Whole database synchronization supports data synchronization to cloud Kafka
View details
2022-09-19 New Features/Specifications
Hologres result table DDL definition partition table
View details
2022-09-19 New Features/Specifications
Hologres dimension table supports the timeout setting of asynchronous requests
View details
2022-09-19 New Features/Specifications
Hologres Catalog supports setting table properties when creating tables
View details
2022-09-19 New Features/Specifications
MaxCompute Sink Connector supports Binary type
View details
2022-09-19 New Features/Specifications
Table Storage OTS Source Connector Publishing
View details
2022-09-19 New Features/Specifications
Hive Catalog supports more Hive versions
View details
2022-09-19 New Features/Specifications
JDBC Connector Publishing
View details
2022-09-19 New Features/Specifications
RocketMQ source table supports more concurrent than topic partitions
View details
2022-09-19 New Features/Specifications
RocketMQ result table supports setting of Message Key
View details
2022-09-19 New Features/Specifications
Support Alibaba Cloud ADB MySQL Catalog
View details
2022-10-19 New Features/Specifications
Enterprise engine VVR version 6.0.2 released | Enterprise important capabilities all-round cloud optimization
View details
2022-12-26 New Features/Specifications
Fully hosted VVR 6.0.4 release | Apache Flink 1.15.2 capability on the cloud
View details
2023-02-20 New Features/Specifications
VVR 6.0.5 Release | Multi function Release and StarRocks Connector Addition
View details
2023-04-13 New Features/Specifications
Flink engine VVR 6.0.6 release, platform revision, connector update and performance optimization
View details
2023-04-13 New Features/Specifications
The first Apache Paimon and Flink Machine Learning preview function | The new version of the whole network step-by-step grayscale release platform
View details
2023-06-21 New Features/Specifications
Version 6.0.7 of VVR was released, strengthening the data control function
View details
2023-08-21 New Features/Specifications
MongoDB CDC connector open test
View details
2023-08-21 New Features/Specifications
CDAS supports stateful restart after adding tables
View details
2023-08-21 New Features/Specifications
Dual stream join supports separate setting of state TTL for different streams
View details
2023-08-21 New Features/Specifications
New OceanBase connector
View details
2023-08-21 New Features/Specifications
SLS connector supports query push down
View details
2023-08-21 New Features/Specifications
SLS Catalog Support Result Table
View details
2023-08-21 New Features/Specifications
ADB PostgreSQL Connector supports ADB PostgreSQL 7.0
View details
2023-08-21 New Features/Specifications
The Tair connector supports more data type writes
View details
2023-08-21 Fix problems
Fix the problem when reading PolarDB MySQL from MySQL source tables
View details
2023-10-23 New Features/Specifications
Optimize automatic tuning capability
View details
2023-10-23 New Features/Specifications
Support SQL data kinship capability
View details
2023-10-23 New Features/Specifications
Dynamic update of resources
View details
2023-10-23 New Features/Specifications
Support RAM roles, resource directory members, and cloud SSO user login authentication
View details
2023-10-23 Function optimization
MaxCompute connector optimization
View details
2023-10-23 Function optimization
MySQL Catalog supports optimization
View details
2023-10-23 Function optimization
StarRocks connector enhancements
View details
2023-10-23 Function optimization
Hologres result table supports using Date type as partition key
View details
2023-10-23 Function optimization
RocketMQ connector function enhancement
View details
2023-11-27 Function optimization
MySQL Catalog enhancements
View details
2023-12-07 New functions/specifications
Add management resource queue
View details
2023-12-07 New functions/specifications
Task arrangement (public test)
View details
2023-12-07 New functions/specifications
Query scripts support Call, DDL, DQL, and DML syntax.
View details
2024-01-04 Function optimization
Optimize MySQL CDC
View details
2024-01-04 Function optimization
MongoDB connector function optimization
View details
2024-01-04 New Features/Specifications
Support MongoDB Catalog
View details
2024-01-04 Function optimization
Hologres connector enhancements
View details
2024-03-13 New Features/Specifications
High availability in the same city
View details
2024-03-13 New Features/Specifications
Free monitoring service
View details
View all logs

Help Documents