Jump to content


Photo

New from Microsoft - 'Lincoln - Mobile search using pictures

- - - - -

  • Please log in to reply
27 replies to this topic

#1
lzitnick

lzitnick

    Newbie

  • Members
  • Pip
  • 4 posts
This has just been posted on MoDaCo by Microsoft themselves! ;)

Hi,

I’m Larry Zitnick from Microsoft Research. We’ve been working on a Smartphone prototype that just got released to the public called “Lincoln”. The basic idea behind the app is to allow people to search for info using cell phone images. For example, say you’re in Blockbuster and you want to find out more info on a DVD. With this app, you can take a picture of it, the DVD is recognized from the picture, and sends you back Amazon reviews. For more info check out:

http://lincoln.msresearch.us/

You can also read an article about it at:

http://www.technolog...Infotech/18368/

We’re looking for people to find creative ways for using this technology. Currently, we’ve preloaded the database with about 1,000 DVDs with Amazon reviews that should be in your “New Releases” section of your video store. We’re also allowing anyone to upload their own photos with corresponding web links to the database for others to search against (Say you’re in a band. You can upload your band’s concert poster so that anyone who takes a picture of it will be sent to your band’s webpage.)

Hope you get a chance to check it out. Feedback is always welcome.

-Larry

I have a lot of respect for the Microsoft Research guys, and Lincoln sounds like a very exciting concept that's in need of some community involvement to load in some data!

What are you waiting for? Head over to the site (in IE by the way) and give it a go :D

P

Attached File  Screen001.png   12.89KB   80 downloads Attached File  Screen002.png   58.02KB   79 downloads Attached File  Screen005.png   28.32KB   67 downloads


[Edited for news by Paul (MVP)]

  • 0

#2
awarner

awarner

    Staff Team Leader

  • Admin Team
  • PipPipPipPipPipPip
  • 18,499 posts
  • Gender:Male
  • Location:Southampton
  • Interests:Life the universe and everything in it :)

    Lumia 925 one hell of a camera phone
  • Devices:Lumia 925 a real phone at last
  • Twitter:@ashwarner
Interesting idea ;)

  • 0
Twitter me @ashwarner

Windows Phone 7 Expert.
Windows Phone Business Specialist



#3
Confucious

Confucious

    Peanut Brain

  • MoDaCo Gold
  • PipPipPipPipPipPip
  • 6,635 posts
  • Gender:Male
  • Location:Surrey, England
  • Devices:iPhone 5
  • Twitter:@Confuciousmobil
Sounds a good - I was just about to ask if it worked on PPCs as well and according to the site it does! Also the .net cab is there - in the past I've not found anywhere where you can download just the cab!

Is the database US centric at the moment? UK films, I believe, often have different covers. But the general concept certainly sounds like a winner - provided the quality of the pics is good enough to be recognised - only one way to find out! I'll give it a try.

  • 0
He who asks a question looks foolish for 5 minutes. He who doesn't ask a question remains foolish forever.

#4
PaulOBrien

PaulOBrien

    It's My Party

  • Founder
  • PipPipPipPipPipPip
  • 36,227 posts
  • Gender:Male
  • Location:Norwich, UK
  • Devices:All the Nexus!
  • Twitter:@paulobrien
Promoted to News, cheers awarner for pointing me at this ;)

P

  • 0

You can follow me on Twitter - http://twitter.com/paulobrien / Follow MoDaCo on Twitter - http://twitter.com/modaco

Want to donate? MoDaCo is raising money for the Multiple Sclerosis society.

Posted Image


#5
tsutton

tsutton

    Need answers? Use the search feature. :)

  • Moderator Team
  • PipPipPipPipPipPip
  • 2,225 posts
  • Gender:Male
  • Location:Near Norwich, UK
  • Devices:Galaxy S2/HD2 (Andriod)
  • Twitter:@tony_sutton
Interesting. But it didn't work for me. See attached screenshot...

However for older releases, it worked. I guess the Queeen DVD is too new. ;)

Attached Files


Edited by tsutton, 14 March 2007 - 08:37 AM.

  • 0
- Tony Sutton
- My Ford Focus ST170 car | My Car's Dashcam Video

#6
tsutton

tsutton

    Need answers? Use the search feature. :)

  • Moderator Team
  • PipPipPipPipPipPip
  • 2,225 posts
  • Gender:Male
  • Location:Near Norwich, UK
  • Devices:Galaxy S2/HD2 (Andriod)
  • Twitter:@tony_sutton
Made my first submit for this Queen dvd. ;)

  • 0
- Tony Sutton
- My Ford Focus ST170 car | My Car's Dashcam Video

#7
awarner

awarner

    Staff Team Leader

  • Admin Team
  • PipPipPipPipPipPip
  • 18,499 posts
  • Gender:Male
  • Location:Southampton
  • Interests:Life the universe and everything in it :)

    Lumia 925 one hell of a camera phone
  • Devices:Lumia 925 a real phone at last
  • Twitter:@ashwarner

Promoted to News, cheers awarner for pointing me at this :D

P


I was just leaving to go to work at 5am so could not put in News myself ;)

  • 0
Twitter me @ashwarner

Windows Phone 7 Expert.
Windows Phone Business Specialist



#8
PaulOBrien

PaulOBrien

    It's My Party

  • Founder
  • PipPipPipPipPipPip
  • 36,227 posts
  • Gender:Male
  • Location:Norwich, UK
  • Devices:All the Nexus!
  • Twitter:@paulobrien
It 'got' my Curious George DVD (see pics in first post)...

Well, by 'my' I mean 'Lucie's', obviously ;)

P

  • 0

You can follow me on Twitter - http://twitter.com/paulobrien / Follow MoDaCo on Twitter - http://twitter.com/modaco

Want to donate? MoDaCo is raising money for the Multiple Sclerosis society.

Posted Image


#9
Confucious

Confucious

    Peanut Brain

  • MoDaCo Gold
  • PipPipPipPipPipPip
  • 6,635 posts
  • Gender:Male
  • Location:Surrey, England
  • Devices:iPhone 5
  • Twitter:@Confuciousmobil
Just tried on my Universal and got "An unknown Error occured [Wednesday 10:29 am]" when I clicked capture - has anyone tried it on a PPC yet - s/ware installed OK but maybe it is only SmartPhone at the mo.

  • 0
He who asks a question looks foolish for 5 minutes. He who doesn't ask a question remains foolish forever.

#10
PaulOBrien

PaulOBrien

    It's My Party

  • Founder
  • PipPipPipPipPipPip
  • 36,227 posts
  • Gender:Male
  • Location:Norwich, UK
  • Devices:All the Nexus!
  • Twitter:@paulobrien
I used it on my Pocket PC (as you can see in the screenshots!).

P

  • 0

You can follow me on Twitter - http://twitter.com/paulobrien / Follow MoDaCo on Twitter - http://twitter.com/modaco

Want to donate? MoDaCo is raising money for the Multiple Sclerosis society.

Posted Image


#11
Demens

Demens

    Newbie

  • Members
  • Pip
  • 12 posts
  • Devices:Htc Wizard

Interesting. But it didn't work for me. See attached screenshot...

However for older releases, it worked. I guess the Queeen DVD is too new. ;)



Hahah, i got the same result from a Merlin -movie.

I also tested toilet paper, Mach 3 turbo, 360 controller, spiderman 2 movie, National treasure, Clive Barkers Undying and constantine.
Only constantine worked and it brought the same amount of info that could be read from the back cover. :D

But still, cool application. Would be nice if it worked, no more awkward googling for a game review while standing on the store.

  • 0

#12
Knocksock

Knocksock

    Newbie

  • Members
  • Pip
  • 7 posts
  • Devices:All i-mates/Qtek/HTCs
It didn't work to take a picture of an baguette to see some adult covers - so I tried Aeon Flux with my i-mate JAMin and it worked like it should smooothly! ;)

  • 0

#13
mcwarre

mcwarre

    I've always wanted to explore the Pacific rim

  • Members
  • PipPipPipPipPipPip
  • 2,329 posts
  • Gender:Male
  • Location:Lincoln
  • Devices:Samsung: Galaxy S2 & Tab 10.1
As I am from Lincoln can I get free access or does my City have to sue Microsoft? If not we will change our name to Vista.... ;)

  • 0
"Success is not to be measured by the position someone has reached in life, but the obstacles he has overcome while trying to succeed."

Booker T. Washington

#14
Monolithix

Monolithix

    Hardcore

  • MoDaCo Gold
  • PipPipPipPipPipPip
  • 8,783 posts
Same problem here on my Universal Confucious...

Just tried on my Universal and got "An unknown Error occured [Wednesday 10:29 am]" when I clicked capture - has anyone tried it on a PPC yet - s/ware installed OK but maybe it is only SmartPhone at the mo.


  • 0

I still exist


#15
Confucious

Confucious

    Peanut Brain

  • MoDaCo Gold
  • PipPipPipPipPipPip
  • 6,635 posts
  • Gender:Male
  • Location:Surrey, England
  • Devices:iPhone 5
  • Twitter:@Confuciousmobil
I wonder if it's the res? Quickmark for the Universal took a lot longer than other PPCs - is there something different about the camera? or just the res?

  • 0
He who asks a question looks foolish for 5 minutes. He who doesn't ask a question remains foolish forever.

#16
PaulOBrien

PaulOBrien

    It's My Party

  • Founder
  • PipPipPipPipPipPip
  • 36,227 posts
  • Gender:Male
  • Location:Norwich, UK
  • Devices:All the Nexus!
  • Twitter:@paulobrien
IIRC the Universal has some odd problems with it's WM5 Camera API... that's what I imagine the problem is (i.e. it's not supporting the generic API properly).

P

  • 0

You can follow me on Twitter - http://twitter.com/paulobrien / Follow MoDaCo on Twitter - http://twitter.com/modaco

Want to donate? MoDaCo is raising money for the Multiple Sclerosis society.

Posted Image


#17
Confucious

Confucious

    Peanut Brain

  • MoDaCo Gold
  • PipPipPipPipPipPip
  • 6,635 posts
  • Gender:Male
  • Location:Surrey, England
  • Devices:iPhone 5
  • Twitter:@Confuciousmobil
I was thinking the res is just the screen, the camera res is fairly std. I wonder why the camera API is not handled correctly in WM5 - or, I should imagine - WM6 ;)

  • 0
He who asks a question looks foolish for 5 minutes. He who doesn't ask a question remains foolish forever.

#18
Monolithix

Monolithix

    Hardcore

  • MoDaCo Gold
  • PipPipPipPipPipPip
  • 8,783 posts
Heh, interesting you should mention that Confucious... ;)

  • 0

I still exist


#19
lzitnick

lzitnick

    Newbie

  • Members
  • Pip
  • 4 posts
Thanks to everyone for trying Lincoln and for adding images to the database! The more images we have the more useful this is for everyone.

Let me try and answer some of the questions that have popped up.

1. Does it work for Pocket PCs? Yes, it does on some models. The Lincoln app launches the camera app on your pocket PC/Smartphone and then looks for the image saved in a certain location. We’re looking into whether some models save the image in a different location than we’re expecting or whether the resolution is unsupported.

2. What does it recognize? Lincoln can recognize flat or curved printed things, like DVDs, posters, CDs, books, etc. It also has to be in our database for us to recognize it (currently this is mostly limited to DVDs). Some things we can’t recognize are people, your pet cat, clothes, plants, etc. Objects which change shape or have a lot of 3D structure are hard for our system.

Let us know if you have any other problems/ideas.

-Larry
MS Research

Edited by lzitnick, 15 March 2007 - 05:28 AM.

  • 0

#20
PaulOBrien

PaulOBrien

    It's My Party

  • Founder
  • PipPipPipPipPipPip
  • 36,227 posts
  • Gender:Male
  • Location:Norwich, UK
  • Devices:All the Nexus!
  • Twitter:@paulobrien
Is there a way to bulk add content Larry? Say, via XML?

(also sent via email)

P

  • 0

You can follow me on Twitter - http://twitter.com/paulobrien / Follow MoDaCo on Twitter - http://twitter.com/modaco

Want to donate? MoDaCo is raising money for the Multiple Sclerosis society.

Posted Image





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users