Baidu Elastic search search analysis service

Baidu Elasticsearch is a retrieval and analysis service based on open source Elasticsearch. Elasticsearch Kibana, Logstash and other open source fully hosted product services. With cold and hot separation, vector retrieval and other product characteristics. Provide low-cost, high-performance, secure and reliable services.

[New function] Release of new vector retrieval capability, providing high-performance vector retrieval capability, and efficient storage of multi-dimensional vector data Learn now

  • Product specification
  • Product characteristics
  • Application scenarios
  • Open source self built comparison
  • Customer Stories
  • Product Dynamics
  • Documentation and Tools

Product specification

See more product specifications

 background

Baidu Elasticsearch

Baidu Elasticsearch is ready to use, automatic operation and maintenance, and rich monitoring indicators to help customers quickly start business analysis

Node Type

Node configuration specifications

SSD cloud disk

Number of data nodes

Universal

2-core 8G

512G

3

two thousand three hundred and seventy-two point four zero /Month
Buy Now
 background

Baidu Elasticsearch

Baidu Elasticsearch helps users reduce operation and maintenance costs through out of the box, automatic operation and maintenance, and rich monitoring indicators

Node Type

Node configuration specifications

SSD cloud disk

Number of data nodes

Computational

2-core 4G

512G

3

two thousand and eighty-one point four zero /Month
Buy Now
 background

Baidu Elasticsearch

Baidu Elasticsearch built-in word segmentation plug-in based on Baidu NLP technology to help customers quickly start business analysis

Node Type

Node configuration specifications

SSD cloud disk

Number of data nodes

Memory type

2-core 16G

512G

3

two thousand nine hundred and fifty-four point four zero /Month
Buy Now

Product characteristics

Efficient and easy to use

Fully hosted Elasticsearch Kibana and Logstash services are available out of the box. Support multi region/availability to avoid accidental data loss or service downtime

Flexibility

Adopt cloud native distributed architecture, support horizontal expansion and vertical expansion of clusters, one click expansion, meet the peak and valley changes of business demand, ensure business is not damaged and service is sustainable

Open source compatibility

Support Elasticsearch native API, ES native users can switch and use smoothly, reduce user transformation costs, and help businesses go to the cloud

Enhanced features

Self developed cold and hot separation function based on BOS to help users greatly reduce costs. Self developed vector retrieval capability, support and optimize multiple index algorithms and similarity distance calculation, and achieve excellent vector retrieval performance

Application scenarios

Observational analysis
Large model knowledge base
Search recommendation
Data analysis
 Observational analysis

Scenario Overview

With the increasing complexity of enterprise technology architecture and business operation, a large number of logs and monitoring data will be generated in the operation of business systems. Under various application scenarios such as enterprise infrastructure operation and maintenance, system monitoring, problem diagnosis, operation monitoring, attack traceability, data archiving, log audit, business insight, etc., it is necessary to conduct unified collection, storage, and real-time monitoring and analysis of various logs and indicator data, so as to quickly locate problems and improve enterprise operation and maintenance and operational efficiency

We can provide

Low cost storage solution

The object storage BOS based cold and hot separation architecture ensures the query performance while significantly expanding the disk storage space and significantly reducing the data storage cost

Unified data transmission processing

Hosting Logstash service, providing data transmission and data processing capabilities, creating a classic ELK solution

Visual observation capability

Combined with Kibana Grafana supports various data visualization and observation capabilities, and implements monitoring alarms in coordination with business alarm strategies

Open source compatible extension

Query/write APIs are compatible with open source ES, users have no additional learning costs, and access threshold is low

Related products

Open source self built comparison

Cloud native architecture, self developed rich functional features, compared with open source self built, provides high performance, high availability and low-cost services

Function classification
Function point
Function description
Baidu BES
Open source ES
Cluster operation and maintenance management
One click deployment
One click creation of ES cluster and Logstash cluster
-
Elastic expansion
Smooth and elastic capacity expansion, no need to stop service, no service perception
-
Version upgrade
One click upgrade of ES version and kernel version
-
configuration management
Provide flexible YML configuration
-
Synonym Management
Support uploading synonym plug-in and dynamic updating of thesaurus
-
Plug in management
Flexible installation management of 10+system plug-ins and user-defined plug-ins
-
SQL parsing
Support queries using SQL syntax
-
Log Query
Support query of cluster main log, slow log GC logs and other logs
-
Monitoring alarm
Provide 30+cluster and node monitoring items, and support monitoring alarm through BCM
-
Data volume observation
Support the observation of index data volume changes to facilitate fine-grained analysis, operation and maintenance services
-
Scheduled scheduling
Support scheduled index management, scheduled data backup, scheduled Forcemerge and Rollover
-
performance optimization
Vector retrieval
Support FLAT HNSW, IVF and other index algorithms, support cosine, inner product and Euclidean distance calculation, built-in multiple quantization algorithms, and provide efficient vector retrieval capability
-
NLP Chinese word segmentation
Baidu self-developed word segmentation plug-in, accumulating years of natural language processing experience
-
Cost optimization
BOS cold and hot separation
Self developed cold and hot separation storage scheme based on object storage BOS, greatly reducing storage costs
-
Index compression
ZSTD compression algorithm plug-in is provided, with higher compression ratio
-
High availability
Data backup
Realize data backup and protection with Baidu object storage BOS
-
Live more in the same city
Support the deployment of multiple zones to achieve multiple live in the same city
-
Remote disaster recovery
Support cross cluster replication (CCR) to replicate data from the production cluster to the disaster recovery cluster
-
Cluster/node current limiting
Support flow limiting for high concurrency and large queries to improve stability
-
security
Public network access
Support private network VPC, security group and public network access to EIP
-
Transmission encryption
Support HTTPS communication protocol to improve data transmission security
-
access control
Multi user access control to help users manage access rights to resources under cloud accounts
-
Permission management
Support document and field level permission control settings
-

Customer Stories

Product Dynamics

All dynamic

  • Support IDaaSMFA multi factor authentication
    High risk operations support secondary verification by SMS or dynamic verification code.   2022.06.01 detailed
  • Support the creation of dual zone clusters
    It supports the deployment of the master dedicated master node in two zones to achieve high availability.   2022.08.01 detailed
  • Publish OpenAPI
    It supports calling OpenAPI for configuration changes, scheduled scheduling, cluster restart, cluster start/stop, automatic renewal and other operations.   2022.08.01 detailed
  • Supporting Elastic search version 7.10
    It supports the Elastic search version 7.10, which is compatible with the 7.4.2 feature, and supports the creation and use of the 7.10 cluster.   2022.09.01
  • New release of vector retrieval capability
    Self developed vector capability, supporting multiple index types and similarity distance algorithms.   2023.08.01 detailed
  • Launch new log management function
    Support users to view main logs, query slow logs, index slow logs GC logs ES access log, etc.   2023.09.28 detailed
  • Support mixed retrieval capability
    Support scalar vector hybrid retrieval capability, and optimize query efficiency through intelligent query plan.   2023.10.01 detailed
  • Support kernel version upgrade function
    Support updating and upgrading the kernel version to achieve seamless business transition to the latest version.   2023.10.16 detailed
  • Online edge BES service
    Support the use of BES hosting services at edge nodes, covering more domestic and overseas regions.   2023.11.03
  • Support for enhanced SSD_PL2 disks
    It supports enhanced SSD_PL2 cloud disk (white list open) and performance preconfiguration.   2023.11.23 detailed
  • Support CCR cross cluster replication
    Cluster data migration is realized through CCR (cross cluster replication), which is convenient for users to live in multiple places and access BES services nearby.   2024.01.11 detailed

Documentation and Tools