In this episode, Mark Sarch provides a follow-up to his previous introduction of the Ray-Ban Meta Smart Glasses. He demonstrates several new features including music integration with Apple Music and Spotify, multilingual support for messaging services like WhatsApp, the new Meta AI visual assistance capabilities, and hands-free video calling with WhatsApp and Messenger.
Mark walks through enabling music services in the MetaView app and using voice commands to control playback. He shows how to send multilingual WhatsApp messages by voice. For the Meta AI visual assistance, Mark showcases its ability to describe objects, read text, identify colors, and more - highlighting its limitations as a mainstream device not optimized for comprehensive document reading.
He compares the Meta AI's output to a live video call demonstration with a human assistant reading details from a business card. Mark also explains the process for hands-free video calling on WhatsApp and Messenger by using the capture button and touchpad.
While not a dedicated assistive device, Mark highlights some potentially useful features for visual assistance and hands-free operation.
transcription:
Disclaimer: This transcript is generated by AIKO, an automated transcription service. It is not edited or formatted, and it may not accurately capture the speakers’ names, voices, or content.
Hello everybody, my name is Mark and I'm back once again to talk about Ray-Ban Meta Smart Glasses latest feature available only for US and Canada.
If you haven't heard before about this pair of smart glasses, I highly recommend listening to the episode I made, review of Ray-Ban Meta Smart Glasses, where I talk about unboxing, hardware description and basic tasks that you can do with the voice assistant.
In this episode, I will show 4 of the latest features available for hardware, V4.0, music integration, multilingual support for messenger services, Meta AI available for US and Canada only, and WhatsApp and Facebook messenger video call.
Let's talk first about music integration.
Now, Ray-Ban Meta Smart Glasses support Apple Music and Spotify completely hands-free.
To do this, you have to activate Apple Music or Spotify directly from the MetaView app.
I will show you how to do it.
MetaView Open MetaView MetaView From the bottom you have a few tabs, click on settings, and then from here you have to see Apple Music Button Spotify Button If you listen to my voice not too loud, it's because I have placed the microphone really close to my ear, where you will be able to listen to the music completely hands-free.
Using only your voice, where you can request commands as resume the music, change to the next song, change to the previous song, and also pause.
Just you have to say the magic phrase and it will sound like this.
Hey Meta, resume music.
Hey Meta, next.
Hey Meta, previous.
Hey Meta, pause.
Great, I think you get some idea how this thing works.
Now, I'm going to show you something, but in order to do this request, you have to place the finger on the touchpad.
It's to change to the next radio station.
Press and hold using one finger on the touchpad for two seconds, will change to the next radio station.
Resuming, this is Morgan Wallen.
Here's indifferent.
Now, let's talk about multilingual support for messages service.
This is the first time I send this feature in any voice assistant.
Hey Meta, send WhatsApp message to Alvaro.
Okay, Alvaro on WhatsApp.
What's the message?
Hola Alvaro, que tal, como estas?
Hope you are doing excellent.
Talk to you later.
Message to Alvaro says, hola Alvaro que tal como estas?
Hope you are doing excellent.
Talk to you later.
Ready to send?
Yes.
Sending message.
Now, let's talk about the most interesting feature for our community.
Meta AI, once again, available only for US and Canada.
This feature was released in April 22nd to the general public.
I've been using the Rayval Meta Smart Glasses for the last three months and I've been in role in early access program for about two months.
And let me say that has been changed a lot since I was in early access program.
So, remember, this is a mainstream device.
It's not developer for our visual impaired community.
But always is nice when some mainstream device offers some kind of service useful.
Meta updated frequently the database.
So, if you are looking for some device that allows to read an entire book or maybe three pages of your favorite restaurant menu, the Rayval Meta is not for you.
However, if you would like to get a summary of what's around you using the Meta AI, just give it a try.
It can be useful.
Let's start with the basic, recognize products, colors and more.
Hey Meta, look and tell me what you see.
You are holding a bottle of Coca-Cola.
Yes, you are right.
Hey Meta, look and tell me what you see.
There are four oranges on a wooden table.
Yes, are four orange.
One, two, three and four.
Hey Meta, look and tell me what color is it?
The color appears to be a light blue.
Yes, it is light blue or also want to try something else.
Okay Meta, look and tell me what's on the label.
The label shows the brand name Cactus Man Ricky Singh and size information.
What's the size information?
The size information on the label is EURM, which means it's a medium sized shirt.
Hey Meta, look and tell me what you see.
You are holding a can of Mike's Harder Strawberry Beverage.
How many ounces of the can on the picture?
The can in the image appears to be a standard 16 ounce size.
What's the flavor of the can on the picture?
The flavor of the can in the picture is Mike's Harder Strawberry.
Can you describe me what color is the can?
The can in the picture is primarily red and silver.
Great.
Hey Meta, look and tell me what you see.
I see a wall mounted TV, fireplace mantel with decorations and framed pictures on the walls.
What's the television manufacturer?
The television manufacturer is Samsung.
You already figured out.
In order to get better results, you have to make specific phrases to get the specific answers.
Let's see one of the few examples where it can be really, really useful.
Hey Meta, look and tell me what kind of plant is this one?
The plant appears to be a Ficus microcarpa, commonly known as the bonsai tree.
How tall is the bonsai tree?
The height of the bonsai tree in this image appears to be around 12 to 18 inches, 30 to 45 centimeters tall.
Great.
Hey Meta, look and tell me what you see.
This appears to be a dining area with a table and chairs.
How many chairs are on the picture?
There are four chairs in the dining area.
How many times you've been in indoor buildings?
So by yourself and where the building has many suite numbers and you've been looking for one specific suite number.
So may you wonder what kind of door or doctor saw is in this door?
Or maybe it's to know what is the main entrance?
Or where are the stairs?
Where are the elevators?
Or where is the exit?
Or, you know, yeah.
Let's find the next examples, indoor buildings.
Look and tell me what you see.
I see a vending machine and stairs in a building's entrance.
Hey Meta, look and tell me what you see.
This appears to be a door with a sign that says Quest Diagnostics and lists the hours of operation as Monday through Friday, 7 a.m. to 12 p.m.
Look and tell me what the text.
Sure, the text on the door reads Quest Diagnostics.
Is there anything else I can help you with?
No.
Hey Meta, look and tell me what you see.
I see a door with a sign that says Paula Elmi, DMD Endodontics and lists the hours of operation.
Hey Meta, look and tell me what the text.
Sure, here's the text on the door.
Paula Elmi, DMD Endodontics, hours of operation, 9 a.m. to 5 p.m.
Monday to Wednesday, Friday, closed Thursday, Saturday, Sunday.
Hey Meta, look and tell me what you see.
I see a person standing in front of what appears to be an office building entrance with a mailbox nearby.
Look and tell me what you see.
I see a hallway with white walls, a door and mailboxes.
Hey Meta, look and tell me what you see.
Hey Meta, look and tell me what you see.
It appears to be a large gray building with cars parked in front of it.
There are also some trees and parking spaces made for people with disabilities.
How often has it happened to you?
And I'm still laughing.
When the right service drivers do not have communication at all with you.
How many times have you seen that?
Well, it happens to me many times.
Unfortunately, I didn't have a chance to record another day, but here you go, here's one of the examples that you can use in order to look at that specific vehicle using the Meta AI.
Hey Meta, look and tell me what you see.
There appears to be two vehicles parked in the driveway.
Hey Meta, look and tell me what you see.
There appears to be a red Jeep Grand Cherokee and another vehicle parked in front of the house.
Are you able to see a blue car?
Yes, I can see a blue car in the image you provided.
It appears to be parked next to a red Jeep Grand Cherokee.
Here you go, I'm going to walk and find a vehicle.
Hey Meta, look and tell me what you see.
This appears to be a blue Dodge Charger.
Yeah, this is a vehicle.
Also, how you can follow Meta AI conversation, making specific phrases in order to get specific answers.
Take a look on the next example.
Okay, I'm here and I'm going to try asking some experiment and see how the answers are.
Hey Meta, look and tell me what you see.
This appears to be a residential home with a porch and steps leading up.
How many steps are on the picture?
There are three steps leading up to the porch.
According to the picture, where is located the door?
The door is located at the top of the steps on the left side.
Great.
Okay, I'm going to start walking.
Let's see.
One, two, three, and there's what?
The door, yes, is on the left side.
It works.
This is the last example and I left almost to the end of the episode.
In order to compare what's the results that I received using Meta AI with a video call a real people.
Okay, let's take a look.
Hey Meta, look and tell me what you see.
It appears to be a business card for Pacific Foot and Ankle Associates Inc.
What's the doctor's name?
I can't help with requests to identify people or discuss their appearance.
What's the doctor's name on the business card?
The doctor's name on the business card is Edwin Ogurian, DPM, FACMSP, FAPWCA.
What's the address on the business card?
The address on the business card is 150 West Foothill Boulevard Suite F, San Dimas, California, 91773.
What's the cell phone number on the business card?
The phone number on the business card is 626-385-3338.
It's also listed as a fax number, which may not be used for communication in modern times.
You can contact them through email at info at yourreverse.com instead.
Facebook Messenger video call, same business card, compare the results.
Hey Meta, make Facebook Messenger audio call to let it...
On Messenger call, right, calling...
Hey Letty, how are you?
Hi Marco, I'm doing well.
And yourself?
Good, thank you.
So I'm going to send you the camera request because I need some help in order to read some business card.
Can you do it?
Yes.
Okay, I'm going to send a request.
Glasses camera is active.
Okay, did you get it?
Yes, I did.
Okay, so yes, I have here a business card, let me know.
So if you are able to see it and how to align it.
Can you get it a little closer to you?
Sure.
Right there?
A little bit more.
Okay.
Perfect.
I can see it now.
Yes.
Okay.
So you want me to read it for you?
Yes, the entire business card.
Okay, so it says Pacific Food and Ankle Association Inc.
Food and Ankle Medicine and Surgery.
It has a website www.youreverystep.com.
The doctor name is Edward O'Gurion, DPM, Podiatric Surgery and Care.
The address is 150 West Foothill Blvd, San Dimas, CA 91773, phone number is 62385338, fax number is 626914.
I think that's enough.
Yeah, I think that's enough with all the information.
Thank you so much.
Okay, thank you.
Thank you.
Bye, I'm going to end it.
Bye.
What's up in Messenger video calls with Rayval Meta Smart Glasses without even touching your phone.
It's really simple.
Just request to Meta, make an audio WhatsApp or Messenger call when this has released, press twice the capture button and it will send a camera request.
And just to end it, the video call, press twice on the touchpad.
Thanks for listening.
Enjoy.
Write your comments.
Peace.
Comments
Great podcast.
Well done on making it.