Following questions aroused while implementation of the project. 
  • Part1: How will the motion transfer of the real character to the virtual character on screen happen?
  • Part2: How will the Background interact?
  • Part 3: How will screen share on happen?

Overview:
Child 1 hand puppet interacts with a device, which lets the computer detect the motion of the real hand puppet.
This motion is transferred on the virtual puppet, which makes the puppet imitate real puppet. Another kid who can see his and other friend’s puppet on screen together shares this screen.



Mock-ups and Proto-types:
To test and understand which technology is best suitable for implementing the idea, there were various trials and mock ups build. There was fair study conducted on current technologies evaluating whether it will support the project.





According to the study none of the existing products in market will enable puppet detection; therefore the project needed experimenting and identifying new ways of achieving puppet detection.

Following mockups were build up.
• Testing 1 - Blob Detection:
   Limitations:
- Requires high level of Image processing. 
- Removing of background so that the puppet is visible fully with the story background is    tedious. 
- Not accurate and jittery. 
- Constraint of keeping the puppets distinct in contrast colours.

• Testing 2 - Mouse recognition to the jaw:
Test 1 Using computer mouse (2 finger)
Limitations:
- Can be used only for sock puppets.
- Positioning and puppet movement was undefined.



• Testing 3 - Using IR LED:
Limitations:
- Defining which is what part of puppet.
- Dark Room so that there is no disturbance from the room light or background.



• Testing 4 - Using LDR (2 fingers):
Limitations:
- Can be used only for sock puppets. 
- Positioning and puppet movement was undefined. 
- Inaccurate as the ambience light varies from time to time.

• Testing 5 - Glove:
The glove gives accurate values and is extremely easy to play with, as it has comparatively less constraints for the child to follow. But it is a tech heavy and complicated solution. If a simpler and frugal way is figured out the solution will become more reachable by mass. If the sensors are embedded in the puppet features e.g. using IR or other sensors, the puppet will be more intuitive and less expensive.
 

• Testing 6 - Blob detection with character:
   Limitations:
- Disturbance from the room background.
- Requires image processing.
 

 

• Testing 7 - Android app color detection:
- Identifies one colour, and gives out the shape of the colour.
- Slow processing.
- If given 2 colour bands in 3 fingers, the background colour disturbance can be avoided.



• Using Camera Recognition:
- Tracking colour with a rectangle box.
- Very fast and responsive.
- Background could be a hindrance.