Abstract: This article is compiled from the Alibaba Cloud open source big data platform Xu Bangjiang (snowstorm). The Flink CDC project donated by Alibaba has officially joined the Apache Foundation. The content is mainly divided into the following four parts: 1. New Flink CDC warehouse, new process 2. New Flink CDC definition ..

We are pleased to announce that Flush 0.7 is now officially released! This version has been thoroughly polished around stability, architecture upgrade, performance optimization and security, further consolidating its availability and reliability in the production environment. This edition lasted three months ..

Absrtact: This article is organized from the sharing of the technical experts of Ant distributed computing engine, Calcite Comitter and Flink Contributor Liu Yong, in the Flink Forward Asia 2024 core technology (I) special session. The content is divided into the following three parts: 1. Vector ..

**Abstract: * * This article was compiled from Mr. Ding Guotao, a senior development engineer of Bili Bili, who shared it at Flink Forward Asia 2024 Cloud Native Special Session. The content is divided into the following five parts: 1. Background introduction 2. Function and stability optimization 3. Performance optimization 4. Operation and maintenance ..

Traditional streaming data pipelines usually need to join multiple tables or streams on the primary key to create a wide table. For example, suppose you are building a real-time recommendation engine for an e-commerce platform. In order to provide highly personalized recommendations, your system needs to have a complete 36

In the Open Source Data Engineering Landscape 2025 released at the beginning of the year, Flush was honored to be listed as the "youngest" project, but Flush is the only one in the panorama that has no logo. Since then, many community members and friends ..

Abstract: This article is based on the sharing of Mr. Zhu Ao, senior data development engineer of Taotian Group, at Flink Forward Asia 2024 Streaming Hucang Forum. The content mainly includes the following five parts: 1. Project background 2. Core strategy 3. Solution 4. Project value 5. Future plan ..

Abstract: This article collates the sharing of self delivery Labrador senior big data development engineer, Apache Amoro PMC Chen Zhengyu, in Flink Forward Asia 2024 data integration (I) special session. The content is divided into the following four parts: 1. CDC in cargo application 2. Data input ..

Introduction The Apache Flink community is happy to announce that after four months of version development, Flink CDC 3.4.0 has been officially released. Flink CDC is a popular streaming data integration framework. Version 3.4.0 of CDC strengthens the framework's change of high-frequency meter structure ..

Abstract: This paper collates the sharing of data engineer Lu Wei and flow computing engineer Feng Xiangyu of Zidouyin Group at Flink Forward Asia 2024 Flow Lake Warehouse (II). The content is divided into the following three parts: 1. Background and current situation 2. Paimon lake warehouse practice 3 ..

**Abstract: * * This article was compiled from the sharing of teacher Lin Xiaobo, the head of NetEase game real-time computing&data lake platform, and teacher Chen Yuzhi, NetEase game big data development engineer, at the Flink Forward Asia 2024 cloud native special session. It is mainly divided into four parts: 1. Background 2. Frame ..

Abstract: This article is compiled from Li Xiaoyu, a technical expert of China Unicom, who shared in the Flink Forward Asia 2024 industry solution session. This paper mainly introduces that China Unicom Network Resource Center, relying on the new integrated architecture of Flink+Paimon Lake Warehouse, cracked the traditional digital warehouse processing 10 billion level data ..

**Abstract: * * This article collates the information shared by teacher Yao Yao, e-commerce data engineer of Diaoyin Group, in the Flink Forward Asia 2024 sub forum. The content is mainly divided into five parts: 1. Business and challenges 2. E-commerce traffic modeling architecture 3. E-commerce traffic flow and batch integration 4. Big stream ..

Abstract: This article is compiled from the share of Li Xinhu, the big data architect of China Telecom Group, in Flink Forward Asia 2024 industry solution (I). The content mainly includes the following four parts: 1. Current situation of spatiotemporal data 2. Multi engine real-time scene 3. Typical applications ..

Abstract: This article is compiled from the sharing of Mr. Liang Baobin, senior data development engineer of JD Logistics, at the Flink Forward Asia 2024 forum. The content is mainly divided into the following four parts: 1. Real time warehouse exploration and construction 2. Real time warehouse application 3. Problems and thinking 4. Future ..

Abstract: This article is compiled from the sharing of Mr. Deweike, the head of the real-time data development platform of Zhongyuan Bank, in the special session of Flink Forward Asia 2024 Streaming Lake Warehouse (II). The content is divided into the following parts: 1. Demand analysis 2. Solution 3. Scenario case 4. Status quo ..

**Abstract: * * This article was submitted to Mr. Lin Hailiang, a senior data warehouse engineer in the International Technology Department of Self made Labradors. The content is divided into the following parts: 1. Business introduction 2. Flink's application and challenges in business 3. Flink driven evolution of real-time digital warehouse architecture 4. Future outlook ..

Flink Forward Asia Singapore 2025 is coming! The annual technology feast of Apache Flink community - Flink Forward Asia 2025 will be held in Singapore on July 3! As the top conference of Flink community officially authorized by Apache ..

Abstract: This article is compiled from the sharing of teacher Qi Wenkai, head of Dinky Community and Apache Flink CDC contributor, in the Flink Forward Asia 2024 data integration (II) special session. It mainly tells about Dinky's whole database synchronization technology scheme evolving to Flink CD

Abstract: This article is based on the sharing of Flink Forward Asia 2024 core technology (I) by Mr. Guo Weijie and Mr. Jiang Xiaofeng from the Alibaba Cloud intelligent Flink team, who are also Apache Flink and Apache Celeborn ..