Wyze Video Search Beta

Wow… While not perfect (What AI is) it’s worked very well in some of the searches I have done.

I did a search for “toys”, and I was impressed by the results.

One of the results were my son and I laying on the living room floor putting a new tackle box together.

I also searched Hermit and it showed me events from my Crabitat… A few were of me… but it ain’t wrong :smiley:

4 Likes

Notes taken! Yah - currently it’s only for first-time usage. I will wait for more on-boarding related feedbacks. It’s definitely a key area that we want to make right.

4 Likes

Sounds like some cool stuff coming!

After going into the monitoring tab on the android app a couple of weeks ago, just to peek at what was going on, all my v2, v3, and v3 pro had the event recording settings changed, so I will cautiously wait for this one to go into production first.

1 Like

So far I’ve tried to search specific events I wasn’t home for, (ie. when my daughter got on the laptop, or when my wife broke a glass in the kitchen). In both cases unfortunately the video I was looking for was not found.

Additionally I would have expected the prompt to include some filtering. For example, I said something like, “little girl on laptop (trying to be general) at table in Dining Room.” I assumed this would have focused the search to the area/camera I would have expected this activity.

I also didn’t like that if I placed a filter manually and then hit the search action again it reset all my filters. Often if you don’t get the results you are immediately looking for you might adjust your prompt assuming it’s user error. For example, I attempted “daughter on laptop” at first thinking it would have understood that as a young girl, but with no results I then adjusted to “little girl.” As a LLM I would also assume I could say things like “this morning,” or “yesterday afternoon,” and this would either add filters or at least rank certain results by their relevance to this prompt.

Does this only work with data in the cloud vs on storage disk? One frustration I have with looking back at my videos in general is that fact that I have a Wyze SD card in all of my cameras and yet they all say card is not recognized. I specifically bought the Wyze cards thinking there was something wrong with the generic ones I purchased before, but still none of the cameras ever seem to recognize an installed SD card. If they do, it’s only for a moment, by the time I actually attempt to scrub the recent history there is nothing available. I love having the cloud events, but would be really nice if I could rely on Wyze to actually capture every moment (this would be key to AI search being able to actually find anything in my opinion).

2 Likes

Haha, it does still get a lot of things wrong. Like, I typed in “Insect” and it pulled up a bunch of birds as most relevant.

It DOES work for a lot of stuff that is obvious. It will find my “orange cat” and it will find my daughter’s “Blue car” and it can tell when someone is “running” vs other things. It is VERY USEFUL.

I’m also testing ways to “break” it or test boundaries, and those are some of the ones I’ll share related to “beta testing” feedback:

  • It does have a sense of humor. I asked it to pull up all the videos with “stupid” in them and 8/10 of the initial “most relevant” events it pulled up all had me as the central part of the event :rofl:
  • The most relevant search results for “beautiful” and “Pretty” was this cool event of my smart sprinkler spraying water past a battery cam pro and capturing little water drops spraying across the screen:


    And one of the most relevant events had my wife and kids in it with the kids playing on that old playground.
  • “Spooky” had half the events showing me in them :rofl: and one of my in-laws :joy: and one of my black cat, but some interesting other ones
  • “Disgusting” showed all events of my rear end while I was bent over trying to fix our Cat litter robot. :joy:
  • “Yawn” did indeed pull up events of my baby/toddler with their mouth open in bed, looking like they are yawning.
  • “Serial Killer” - 9/10 most relevant results were events of me, and then one of my wife walking down our hallway (so beware of how you respond to me…j/k)
  • It can’t distinguish between a dog and a cat. All attempts to view events of my neighbors walking dogs past my house never pulled up, but it always showed my cats as if they were dogs.
  • “Happy” was actually pretty impressive (smiling, laughing, kids playing, etc)
  • “Crazy” showed events of me, or our 2 messy areas.
  • “Sunrise” got tricked by showing the bright FLPro light reflecting off my pool water like you often see with the sun on a lake, but this is 10pm at night:

    (though to be fair, that was the 10th most relevant result…the other results were all sunsets)

Some of the searches also helped me realize a couple of my V3Pro’s weren’t recording cloud events because they never showed up in the results, so I checked and saw they hadn’t been uploading events in a while, and I went and restarted them.

4 Likes

So, it works on people, cars, people near cars. But it does not work for my cameras on “garage open” or “garage close.” even though one of my cameras is in the garage facing the garage door.

1 Like

I check to see if the mail delivery vehicle has come so I know to go collect the mail at my box. I tried the AI search but it couldn’t find postal (anything like truck, vehicle, car, carrier) etc. Let me know if I need to try a different search criterion. It would be useful!.

1 Like

I used AI search to search “red head” and it kinda worked! My daughter is a ginger and it picked up on her and my bestie whose more of an auburn.

1 Like

It does work and it’s very useful! It finds simple things but also fails on some simple things. I have two black dogs in many of my event recordings and if I search “dog” it finds nothing. This will be great once the bugs are worked out! Thanks for this feature WYZE!

2 Likes

A new beta app will be out soon, probably not today, but it is coming.

6 Likes

Sounds like a very useful tool, but in my initial testing the results were not great. A search for flag did not pickup the American Flag that clearly waves on one camera, but did seem to pickup the shadow of that same flag on another camera and some flowers that I guess it thought was a flag.
It also did not pickup and dog toys which are constantly scattered around in another camera. I look forward to trying it out in the app once that becomes available and will continue to try to work with it on the web portal.

1 Like

Maybe I’m using it wrong or it’s broken because I can’t get it to find anything. Even simple words like car, dog, trash can.

Yeah there’s something clearly going wrong with some users accounts. Even internal employees are noting the same thing where it looks like it the search bar has been turned on the back end isn’t. Hang tight, I’m investigating this.

4 Likes

Is this AI internal to Wyze, or is it another AI API that Wyze is using?

If an API, who is the source AI?

Is Wyze selling user video data for AI training?

Are all videos saved to Wyze cloud being used to train the AI?

Does the AI have access to your videos if you do no opt into this test?

2 Likes

Well, it’s not working at all. I have tens of cloud-stored videos and whatever I type for the AI search yields an empty search.

One thing to note, my Video Doorbell movies are all rotated 90 degrees to the left. Thus, if the AI is not trained to handle this, no wonder it can’t find a single thing.

Clearly not ready for prime time.

1 Like

Try it now. I think we fixed the problem.

5 Likes

Try it now.

1 Like

Try it now

1 Like

Been trying the search in the portal. I really like it. I said find where a person is in the garage and it only provided my garage and where individuals were present.

I did some other queries to test such as:

  • Show me the pets in my yard. It returned only those video’s where pets or animals were found

  • But… I then said show me the Birds in my backyard. It returned the same result as show me the pets. So it does not filter based on type of pet. :slight_smile:

None the less, very impressive

2 Likes

Very interesting. Definitely leave some feedback on the searches it got wrong. Would help us out a ton.

4 Likes