How would you verify a smile detector in a photo app?

You are on the Google Photos team and your feature detects smiling faces in photos. How would you check that the detection is correct?

Cover what counts as a smile and who decides when people disagree, how you would build labeled test data, which metrics you would track and across which groups of people and photo conditions, and how you would keep checking quality after launch.