best way to playback mouse and keyboard?

hello,
i have a scenario where the video output of a windows machine is
transmitted over IP to my embedded application where it is rendered on
a display device . I have a mouse and keyboard
attached to the embedded box and if i move the mouse or type anything
on the keyboard , i want it to be played back on the windows box just
as if the keyboard or mouse were physically plugged into the windows
machine .
on the embedded side i open the drivers of the keyboard and mouse and
whatever data comes from them , i send it over sockets to the windows
side where my app is listening .
Now what is the best way to play this raw data on the windows machine
.What options do i have ?
do i need to post some WM_ messages , but if yes to what window?
handling all the scenarios like the OS here would be complicated ,
wouldn't it?
the other thing i was thinking of was to make two dummy drivers on
windows side , one each for a keyboard and a mouse and feeed them the
data coming over the socket through some ioctl call and the driver
could handle the data the same way as if it were coming from a "Real"
hardware . Then windows would then be fooled and also behave correctly
according to its own

what other options if any do i have here? any ideas or comments ?
thanks and regards
Taha

cristalink
Sun Dec 12 14:40:40 CST 2004

If you capture raw data at the embedded side, you better feed Windows with
the same raw data. I don't think that high-level WM_s is a good idea. You
can write simple upper mouse/kbd filters sitting above the class drivers and
feeding Windows with raw data. Unless you found a way to do this in user
mode.

--
http://www.firestreamer.com - NTBackup to DVD and DV


"M Taha Masood" <m.tahamasood@gmail.com> wrote in message
news:1102882715.039988.74770@f14g2000cwb.googlegroups.com...
> hello,
> i have a scenario where the video output of a windows machine is
> transmitted over IP to my embedded application where it is rendered on
> a display device . I have a mouse and keyboard
> attached to the embedded box and if i move the mouse or type anything
> on the keyboard , i want it to be played back on the windows box just
> as if the keyboard or mouse were physically plugged into the windows
> machine .
> on the embedded side i open the drivers of the keyboard and mouse and
> whatever data comes from them , i send it over sockets to the windows
> side where my app is listening .
> Now what is the best way to play this raw data on the windows machine
> .What options do i have ?
> do i need to post some WM_ messages , but if yes to what window?
> handling all the scenarios like the OS here would be complicated ,
> wouldn't it?
> the other thing i was thinking of was to make two dummy drivers on
> windows side , one each for a keyboard and a mouse and feeed them the
> data coming over the socket through some ioctl call and the driver
> could handle the data the same way as if it were coming from a "Real"
> hardware . Then windows would then be fooled and also behave correctly
> according to its own
>
> what other options if any do i have here? any ideas or comments ?
> thanks and regards
> Taha
>

Maxim
Sun Dec 12 15:03:02 CST 2004

SendInput can help.

--
Maxim Shatskih, Windows DDK MVP
StorageCraft Corporation
maxim@storagecraft.com
http://www.storagecraft.com

"M Taha Masood" <m.tahamasood@gmail.com> wrote in message
news:1102882715.039988.74770@f14g2000cwb.googlegroups.com...
> hello,
> i have a scenario where the video output of a windows machine is
> transmitted over IP to my embedded application where it is rendered on
> a display device . I have a mouse and keyboard
> attached to the embedded box and if i move the mouse or type anything
> on the keyboard , i want it to be played back on the windows box just
> as if the keyboard or mouse were physically plugged into the windows
> machine .
> on the embedded side i open the drivers of the keyboard and mouse and
> whatever data comes from them , i send it over sockets to the windows
> side where my app is listening .
> Now what is the best way to play this raw data on the windows machine
> .What options do i have ?
> do i need to post some WM_ messages , but if yes to what window?
> handling all the scenarios like the OS here would be complicated ,
> wouldn't it?
> the other thing i was thinking of was to make two dummy drivers on
> windows side , one each for a keyboard and a mouse and feeed them the
> data coming over the socket through some ioctl call and the driver
> could handle the data the same way as if it were coming from a "Real"
> hardware . Then windows would then be fooled and also behave correctly
> according to its own
>
> what other options if any do i have here? any ideas or comments ?
> thanks and regards
> Taha
>

Pavel
Sun Dec 12 16:32:07 CST 2004

This application already exists and is well known (VNC)
--PA

"M Taha Masood" <m.tahamasood@gmail.com> wrote in message news:1102882715.039988.74770@f14g2000cwb.googlegroups.com...
> hello,
> i have a scenario where the video output of a windows machine is
> transmitted over IP to my embedded application where it is rendered on
> a display device . I have a mouse and keyboard
> attached to the embedded box and if i move the mouse or type anything
> on the keyboard , i want it to be played back on the windows box just
> as if the keyboard or mouse were physically plugged into the windows
> machine .
> on the embedded side i open the drivers of the keyboard and mouse and
> whatever data comes from them , i send it over sockets to the windows
> side where my app is listening .
> Now what is the best way to play this raw data on the windows machine
> .What options do i have ?
> do i need to post some WM_ messages , but if yes to what window?
> handling all the scenarios like the OS here would be complicated ,
> wouldn't it?
> the other thing i was thinking of was to make two dummy drivers on
> windows side , one each for a keyboard and a mouse and feeed them the
> data coming over the socket through some ioctl call and the driver
> could handle the data the same way as if it were coming from a "Real"
> hardware . Then windows would then be fooled and also behave correctly
> according to its own
>
> what other options if any do i have here? any ideas or comments ?
> thanks and regards
> Taha
>

Ray
Mon Dec 13 13:07:53 CST 2004

If journaling won't work for you (search for WH_JOURNALRECORD), then the
second easiest mechanism would be to write a user-mode program that
captures the data you want to play back and uses SendInput to inject it
into the OS.

M Taha Masood wrote:
> hello,
> i have a scenario where the video output of a windows machine is
> transmitted over IP to my embedded application where it is rendered on
> a display device . I have a mouse and keyboard
> attached to the embedded box and if i move the mouse or type anything
> on the keyboard , i want it to be played back on the windows box just
> as if the keyboard or mouse were physically plugged into the windows
> machine .
> on the embedded side i open the drivers of the keyboard and mouse and
> whatever data comes from them , i send it over sockets to the windows
> side where my app is listening .
> Now what is the best way to play this raw data on the windows machine
> .What options do i have ?
> do i need to post some WM_ messages , but if yes to what window?
> handling all the scenarios like the OS here would be complicated ,
> wouldn't it?
> the other thing i was thinking of was to make two dummy drivers on
> windows side , one each for a keyboard and a mouse and feeed them the
> data coming over the socket through some ioctl call and the driver
> could handle the data the same way as if it were coming from a "Real"
> hardware . Then windows would then be fooled and also behave correctly
> according to its own
>
> what other options if any do i have here? any ideas or comments ?
> thanks and regards
> Taha
>

--
../ray\..

M
Wed Dec 15 14:00:15 CST 2004

Thanks for the suggestions , SendInput seems to be the thing i need!