Hi professional QA tester here. The quoted request is based on a misunderstanding of the nature and complexities of programing. Anyone with any professional programming or QA testing experience will explain that what is being sought here is absolutely guaranteed 100% utterly impossible for ANY company in our current situation with electronics and using programming to ever promise anyone.
Let me give you a quite simple example. In the following control flow example, this “simple” program consists of up to only FOUR decisions. Just 4 decisions and a loop (even with just 4 decision trees, it could’ve been made almost doubly more complicated if we expanded the decisions on the far right and each subsequent decision…but we’re keeping it as simple as possible). For this SUPER SIMPLE piece of programming/code, if you were to EXHAUSTIVELY test every possible combination of execution with a limit of only 20 cycles, then if it took the tester 5 minutes to execute each test sequence, then complete testing on this small piece of code with as few as 14 lines of code and 4 total decisions to make, it would take the testers ONE BILLION YEARS to finally test everything to be sure it was “fixed period and without exception and in all manner.” One billion years on even the absolute simplest code because even for something so simple it seems almost worthless, there are actually roughly 100 quadrillion sequences of just this stupid easy program.
If a person says, “yeah, but you can run most of the tests automatically and fast for each test case instead of a human testing each case.” Fair enough point in some cases (not always true, but we’ll pretend it is in this case). Let’s assume that each test now only takes FIVE MICRO SECONDS instead of 5 minutes. That’s a more than fair adjustment. That means complete testing on this small piece of code with as few as 14 lines of code and 4 total decisions to make, it would take automatic testing NINETEEN YEARS to finally test everything to be sure it was “fixed period and without exception and in all manner.”
Basically, if anyone is looking for a promise from Wyze (or ANY company that uses programming of any sort) that something is 100% fixed without bugs, etc…it’s NEVER, NEVER going to happen. They would have to be completely insane to ever promise anyone that. Research has proven this fairly conclusively, and that is just for the most simple of code…let alone all the other huge complexities of millions of lines of code and decisions and loops actually being used. Everything Wyze has is infinitely more complex than this smallest of tiny programs.
A promise of no bugs will never be forthcoming. It’s nearly impossible. Best we can do is get indications that most things work okay most of the time with few known critical errors reported with any frequency. It also means if a person wants more stability they should stick to production versions of firmware and software and stay away from beta like the plague. Beta is for helping to test and find the most common and critical bugs and problems which almost for sure, guaranteed, exist in some form…some of them we will find immediately, some of them might take billions of years of testing to discover, but statistically it is pretty guaranteed there are bugs.
If such guarantees are needed, then I would suggest giving away or selling all Wyze devices now because this promise is not only not EVER coming, it is absolutely impossible. Wyze can not possibly eliminate every single bug within our lifetimes. It would be hard enough if their code was only a few lines long and a single product. With everything they have and the amount of code they are using…impossible, utterly and completely impossible. It’s not their fault, it’s math. It’s normal.
Strong recommendation: Avoid Beta like the plague unless you are slightly masochistic, and find bugs and problems to be fun to discover and help resolve and you like eating them for dinner to show them who’s boss, like my friend @spamoni (and many, many others in here) who does an incredible job finding, reporting, testing and helping to resolve bugs constantly to make Wyze better for everyone. This community is awesome at helping make improvements, and I love that Wyze gives us the opportunity to help with this kind of stuff so they can keep pumping out firmware and app updates and improvements at an insane pace compared to most companies. I love helping with Beta, but most people should strongly stick to production to reduce the issues…that’s not to say there aren’t any, there always will be. It’s impossible not to have bugs in something with so much coding, just hopefully a lot of the guys in here helped find a lot of the most important issues first.
Keep up the great work guys. 