Transform open source tools - traffic playback tool goreplay supports pressure test statistics - OSCHINA - Chinese open source technology exchange community

Transform open source tool - flow playback tool goreplay supports pressure measurement statistics

original

2020/06/23 09:28

Reading 2.3K

[Live Preview] How come Rust has not replaced C/C++for nearly ten years?

Back view

At present, the routine performance test of the input method server mainly uses the open-source traffic playback tool goreplay, which is used for traffic playback, and can also be reduced or amplified when playing back traffic to achieve the purpose of performance testing. But it is not a professional tool for performance testing after all, as the saying goes, "It is not his job but his job", Therefore, goreplay is not very good at result statistics. In order to enable it to support client statistics, we need to upgrade it;

Goreplay's own statistics

He said that he did not support result statistics, but he was wronged. The command line of goreplay also supports result statistics. The parameters are: --stats --output-http-stats After adding this command line, the console output is as follows:

The penultimate column is the same as the current QPS, but this is the only statistical item, and there is no distinction between return code, response time, TP90, TP99 and other indicators;

Prometheus

Official website explanation: open source monitoring solution

metrics

The monitoring data source of prometheus. For detailed explanation, please refer to https://www.investopedia.com/terms/m/metrics.asp

Transformation objectives

Let goreplay support real-time metrics statistics. When goreplay performs traffic playback and performance testing, it counts the current QPS, response time and other indicators of goreplay as the pressure test client in real time;

Implementation process

Analyze the source code and find the function that sends the request in the source code;
To obtain the request status code and the corresponding QPS, insert the counter metric at the position where the request return value is obtained;
In order to obtain the response time of different requests and other indicators, it is necessary to record the starttime before sending the request, the endtime after returning the request, and the histogram metric of time consumption;
After goreplay is started, register the metrics interface and the service listening port;
The metrics service of the goreplay client is registered in the prometheus service;
Establish a dashboard in grafana system to count the data indicators required;

effect

Add metrics related code to http_client.go in the source code (see the end of the text for the source code address)
main.go conduct Metrics registration;
Register goreplay_client metrics in the prometheus configuration file
You need to add a command line when starting goreplay -output-http-compatibility-mode true Statistics based on startup results;
When starting goreplay, check the listening port and find that there is a registered 28081
Interface access http://10.1xx.xx.xx:28081/metrics
Performance test indicators required for creating a new dashboard query in grafana:

So far, the transformation of goreplay has been completed. Through metrics, various indicators in the process of pressure testing have been counted from the client;

Source code address. Since the branch submission needs to be reviewed by the goreplay author, a new project has been created on github, which can be downloaded and used `https://github.com/lidedede/gor`

among gor_ldd It is the binary compiled by centos7 and can be used directly; Complete command line attached: ./gor_ldd --input-file "xxx.gor|1500%" --output-http http://10.1xx.xx.xx:1xxx --stats --output-http-stats --input-file-loop -output-http-workers 10000 -output-http-workers-min 5000 -output-http-compatibility-mode true

This article is shared from the WeChat official account Sogou QA.
In case of infringement, please contact support@oschina.cn Delete.
Participation in this article“ OSC Source Innovation Plan ”, welcome you to join us and share with us.

Artrener 2024-07-21 15:12

It can be seen that he is unhappy and 360 is unhappy, but what others say is the truth. For example, people in the aviation industry also said so.

osc_50722289 2024-09-06 13:51

If Apple doesn't give in and WeChat doesn't give in, it will look good! WeChat goes deep into ordinary people's homes in China! Payment social WeChat is inseparable. If WeChat is not updated on IOS, Apple "doesn't have to mix"

z-zg 2024-09-26 13:07

Indeed, it was all the trouble caused by the original bustle. However, with Oracle's cancerous character, it will not be given.

Big back 2024-07-10 14:03

Then the traffic police find the responsible party and call the customer service of the generative AI, which is very powerful

osc_97949904 2024-09-26 11:19

How to highlight a row in a table in a diagram?

exidot 2024-09-26 16:54

I'm really worried if Linux loses Linus and other veteran figures. It is estimated that Linus is also considering the future of Linux by introducing Rust

infoworld 2024-09-11 18:00

Thanks, it is your pioneering work that can avoid being monopolized by foreign systems and applications.

Tobyee 2024-07-09 11:04

No GMS is an excuse. In essence, we still don't want to adapt to domestic mobile phone systems. When Hongmeng Next comes out, we can see whether Microsoft will embrace or not

fzn0268 2024-09-04 14:26

This is the guy who makes code generator

kakai 2024-09-10 12:23

You don't know anything, but you come here with your mouth open. The reason why the exclusive channel draws high is that there is exclusive channel traffic, which means that the platform is guiding your operation. As long as you collect money, 50% is less, and Apple is guiding you? Give more respect to the apple, it will make you rich.

Flat wave 2024-09-26 16:11

very good!

tsdyy 2024-09-26 11:46

Who asked you to change your name from livescript to javascript in order to rub off the popularity of Java? I have to pay it back.

PynixWang 2024-09-26 14:36

It is suggested to use the digital version instead of the year version. The digital version is convenient for ticket skipping. The year version was very awkward.

cyclamenkde 2024-09-26 15:25

OpenHarmony based OS, x86 and arm supported

Flat wave 2024-07-07 16:54

After eating, I smashed the pot, as if it were pure blood. After eating, I wanted to smack the pot of millet, popo and vivo; 😂

kakai 2024-09-07 10:39

Why did WeChat offend you? In any case, it is beneficial for the Chinese people to let Apple reduce the tax rate in China even if WeChat does it for its own commercial interests. This tax rate is not only for WeChat, but also for Apple. What a stupid and shameful statement!

Black toothpaste 2024-07-21 12:12

A real person is invincible if he has no shame. As long as he is not embarrassed, others are embarrassed.

yiyanxiyin 2024-09-26 11:13

How to say, if we regard C as a tool, it is not difficult to learn how to use it basically, but it can make earth shaking things. It is difficult to do it. C is like a pen that everyone can use, but everyone can write different characters, and the difference is not a matter of a pen

yiyanxiyin 2024-09-26 11:14

How to say, if we regard C language as a tool, it is not difficult to learn how to use it basically, but it can make earth shaking things, which is difficult to do. C language is like a pen, which everyone can use, but everyone writes different characters, and the difference is not a problem of a pen

HalLi 2024-09-09 01:10

Even if ordinary users don't understand it, why don't even programmers understand it? Apple is 30% of the whole platform, and domestic channel service is 50%. Where does the big app like WeChat and Tiao Yin get channel service? Besides games, which app brings channel service.

Flat wave 2024-09-26 12:59

I actually have powder, which is really effective; 😂

songdragon 2024-08-14 13:11

There are several problems with the conditions for this comparison. 1. Solomon uses smart http and spring uses undertow 2 The automatic configuration of solon startup itself is less than that of spring, which determines the different dimensions of comparison. The reason for better performance is probably due to the dependency of web server and application configuration. If you want to align, you need to use the same web server. The spring application excludes all automatic configurations and only retains what is necessary for the web to explain the performance gap of the framework. Now, this result does not mean that solon itself has good performance.

Small and beautiful software development 2024-09-26 19:47

I don't know who invented the name and then had to get an internal version number

osc_73214294 2024-09-26 18:02

Next is customized by Huawei based on openharmony. If you say Android is open source, it should correspond to openharmony, which is open source. The customized UIs of various companies will not be open source.

dwingo 2024-07-18 10:12

It's not that jni and unsafe are not allowed to be used. It's just a "restriction". You can continue to use them as long as you add command line parameters. The purpose is to let users consider the security of the program

liming0101 2024-09-10 09:09

What Naji things, but also touch the porcelain black myth

Flat wave 2024-09-26 15:02

Flat wave 2024-09-26 15:07

VERY GOOD!

geeaks 2024-09-26 10:40

HarmonyOS hurry to unify all ends

1km 2024-09-26 14:44

Now AI is getting bigger and bigger

Qsion 2024-09-26 14:39

The crow in the world is black, just choose the one you believe in.

Azeroth008 2024-07-09 10:43

It's good to have a self-developed operating system. What's the mentality of those who spray indiscriminately?

Small and beautiful software development 2024-09-26 19:41

To put it bluntly, I can only indulge myself

Binx 2024-09-07 08:28

It's better to increase the Apple tax to 80%, otherwise how can you show your distinguished Apple user identity

kushu001 2024-08-14 15:24

Why must we emphasize "domestic"? Is it an open source project? If open source, won't you accept the contribution of foreign developers? I'm just curious, can't I promote without "domestic" 😀

Yanlongli 2024-07-11 17:28

It reduces the visual complexity and increases the operation complexity.

blue_think 2024-08-26 11:00

Don't just talk about Huawei. Tell me about your own abilities, how far you have reached, and what achievements you have made. It's a bit persuasive anyway

zb79463626 2024-08-26 15:51

What research and development does IBM China have? All tests! The so-called people engaged in research and development are all working for the elderly!

Small and beautiful software development 2024-09-26 19:44

That's the same thing. Don't be moral. It's yours to kidnap you

Wise sermon 2024-08-13 12:02

No matter who is fighting in Ping'an County, our 358 Regiment will help the field!

0day 2024-07-21 11:52

A rogue should talk about security?

-SORA- 2024-09-26 12:49

Simple grammar is not difficult, but it is not so easy to do a big project after engineering

Small and beautiful software development 2024-09-26 19:42

This is to sell money with other people's resources. Now all kinds of ai are irregular

Jane Roemer 2024-08-12 19:31

Are you connected to the Internet at home? Godson has abandoned MIPS for a long time, and now it is LoongArch. Take a look: https://loongarch.dev/zh-cn/posts/20210501-loongarch-manual/

-SORA- 2024-09-26 12:45

Similarly, both the iPhone and IOS are in Cisco's hands

Small and beautiful software development 2024-09-26 19:45

Ordinary people still use broadband wifi

Outstanding people 2024-07-10 16:17

Can you lie flat, can you cut leeks, and spend money on research and development? For scolding? Say this can cut leeks? You were cut? Did you buy it? Who changes the mac every year and who changes the iphone every year? Huawei users don't seem to do that, do they? I can't stand it for a Xiaomi user!

Solitary Demon Xia 2024-09-26 15:48

😍

osc_73214294 2024-08-05 10:19

I thought there would be more in-depth comments below the articles on this platform, and there would be many blowers.

h4cd 2024-09-26 10:17

This picture of you 👮

Strong ice 2024-07-22 08:41

It's better to say that 90% of domestic computers do not have CrowdStrike software installed

osc_566335 2024-08-01 15:05

"Although they only have college education" - college education is also considered as higher education, is it a level of illiteracy in the mouth of these media now?

I have I can 2024-07-09 11:40

The essence of sprayers is to find reasons for their own darkness and inferiority.

fastfail 2024-09-26 15:00

I didn't learn Rust

My name is Li Gue 2024-09-26 13:53

This is a bit interesting

Kevin586 2024-07-29 17:09

If you really want to reduce costs, you still need to change go. Java eats too much memory

iCooook 2024-09-26 11:21

👏

Flat wave 2024-09-26 15:06

VERY GOOD

My name is Li Gue 2024-09-26 12:28