Add failures stats for CSV report

[ATzxt]

Hi im working on a task to display the speed of failures under load separate from the speed of successes on a graph but it seems like i will have to parse information from the html report directly because the csv report does not have a separate row for failure stats. Can this be addressed. Alternatively if you know of a less cumbersome way of dealing with it could you tell me please. Thanks

[AntyaDev]

Hi @ATzxt
I think we can add failures stats into CSV for our next version 5.9
Does it make sense?

Did you consider any real-time reporting? for example NBomber Studio?

[ATzxt]

Hi @AntyaDev
That would be great thanks. Very appreciated.

I looked into RT reporting briefly but for the moment it seems to be outside our usecase. But i will look into it further for future additions to our load testing framework. Im not currently sure of your development processes. Could you please explain to me what the likely eta of version 5.9 is if you know it. no worries if you cant give any concrete information. Thanks again for responding.

[AntyaDev]

We planned to release version 5.9 by the beginning of March. However, I believe we can launch a beta version with this functionality much sooner.

Let me check—I'm confident it can be ready by Monday.

Hi im working on a task to display the speed of failures

Are you working on a specific UI dashboard or report that will offer more advanced analysis? Could you share more details about your task? Just trying to understand will NBomber Studio help here.

[ATzxt]

hi so yeh its nothing complex its just api load testing. The aim is to run load testing on different days/ after different improvements to our api then plot all the provided statistics from each run under load on a line graph over the course of time to compare the stats at a glance. From there we can then establish baselines and automated failure reporting etc... but thats a long way off for now.

My original issue was basically just that we wanted to do graphs for both the successes and the failures but they didnt come out in the csv. so right now i had the entire html report passed into the DB as a string so that eventually i could parse the html report and get the seperate failure output. That seemed silly tho so I thought id ask if you were willing to make a change or if there was a less silly way of doing it that you knew of.

[AntyaDev]

Hi @ATzxt
Please check this beta: https://www.nuget.org/packages/NBomber/5.9.0-beta-0

[ATzxt]

Hi thank for doing this,
ive attempted to update the codebase we're operating today only to run into a messages that says the method 'System,Threading.Tasks.Task Nbobmer.Contracts.IworkerPLugin.Start' is not found. are there any of your other packages that need to be updated? We were on nbomber version 5.4.1 before today which is likely the cause of the issue.

[AntyaDev]

Can you try to update NBomber.Http and any other NBomber related packages to the latest version

[AntyaDev]

Hi @ATzxt
Any updates?

[ATzxt]

Hi, what happens in order is just like yesterday:
I update all the packages and i get a issue: Detected package downgrade: Microsoft.Extensions.Configuration.Binder from 9.0.0 to 8.0.1 Reference the package directly from the project to select a different version

I then change the package references in the proj file and it builds but then when i try to to run anything i get the issue i mentioned yesterday. All nbomber packages are at their highest level.

[AntyaDev]

Can you please list what other NBomber packages you use?

[ATzxt]

nbomber 5.8.2
nbomber.data 5.0.0

nbomber.Http 5.2.1
nbomber.Contracts 5.6.1

[ATzxt]

Edit: The 5.8.2 works its when it goes to beta that it has a problem from local testing.

[AntyaDev]

Hi @ATzxt
Please try to update NBomber.Http https://www.nuget.org/packages/NBomber.Http/5.2.2-beta.0

[ATzxt]

hi, i will attempt this at somepoint within the next 2-3 days. i may be delayed due to a company meeting. please do not close the issue until i get back to you.

[ATzxt]

Hello ,
it now builds again but give me an error stating unable to connect to testing platform runner process.

[AntyaDev]

I don't know what is the testing runner platform process. You can create a new empty project and try to run to see what will be printout out.

[AntyaDev]

@ATzxt can you tell me your organization name? I think I can jump with you on Slack and can try help

[ATzxt]

I don't know what is the testing runner platform process. You can create a new empty project and try to run to see what will be printout out.

it might be an issue with how our framework is built locally because other than that it now builds. I will double check with other staff here and contact you on monday. thanks for all your help so far.

[AntyaDev]

Hi @ATzxt
Any updates?
Have you tried to run just by creating a new project that references the latest NBomber beta?

[AntyaDev]

will be released in 5.9

[ATzxt]

hi, sorry for the delay in recontact, i was temporarily assigned to something else. i will be resuming this correspondence and by extension this work in the following days.

[AntyaDev]

Sure, np

[ATzxt]

hello, In trying to pick up where we left off today I received this error message:

error: Init scenario error: 'System.MissingMethodException: Method not found: 'Void NBomber.Contracts.IMetricsProvider.RegisterMetric(System.String, System.String, Double, NBomber.Contracts.Stats.MetricType)'.
at NBomber.Http.HttpMetricsPlugin.NBomber.Contracts.IWorkerPlugin.Init(IBaseContext context, IConfiguration infraConfig)
at [email protected]()' (0.4s)

These are the packages im working with:

PackageReference Include="NBomber" Version="5.9.0-beta-0"
PackageReference Include="NBomber.Contracts" Version="5.7.0-beta.3"
PackageReference Include="NBomber.Data" Version="5.0.0"
PackageReference Include="NBomber.Http" Version="5.2.1"

Any help you could provide would be appreciated thanks.

[AntyaDev]

Hi @ATzxt
You need to restore the latest beta versions.
If you check the Nuget you will see:
NBomber 5.9.0-beta-4
NBomber.Contracts 5.7.0-beta.5
NBomber.Http 5.2.2-beta.1

[ATzxt]

thanks. ill try that now

[ATzxt]

thanks that seems to be working. Your help is most appreciated. (btw im attached to the company FSL who have purchased an nbomber license. ) If there is anything else relating to this ill let you know.

[AntyaDev]

Thanks @ATzxt!
These changes will be available in the v5.9 release on March 1.

Feel free to ask any questions or set up an online meeting if you need any guidance.