Remote control of an Android is technically possible?

Asked

Viewed 1,450 times

30

Today I saw the following video: https://www.youtube.com/watch?v=9J7GpVQCfms

Shows a bracelet that projects the screen of an Android phone paired on the user’s arm. This then can manipulate the cell by moving the finger on your arm.

The video seems to me clearly a montage (in several moments the projection of the screen does not properly follow the movement of the camera and the apparatus responds excessively fast to inputs). But the company exists and is raising funds to launch a prototype, so it is possible that they merely made a promotional video without having the prototype ready.

What left me in doubt is, assuming it’s all real, how would they make an app that streams from the Android screen and allows you to fire Gesture events on the device? Is that even possible? Or is it a solution only for devices with root and that have been modified in some way? (If this is possible, why companies like Teamviewer have not yet made a remote control client for Android?)

  • 2

    I find the idea very interesting. But I think the Airdroid (https://play.google.com/store/apps/details?id=com.sand.airdroid&hl=pt_BR) allows the device to be controlled by the browser.

  • 1

    @Wakim allows you to send commands to your phone and get answers, but never see the device screen or control other applications. You can list contacts, view notifications, and transfer files. That’s the only thing. Try installing ;)

  • @Guilhermebernal has more strange things in this project than this. One of them is that the projection angle is at least "suspicious". The slightest inclination of the bracelet will change the proportions of the screen absurdly. And if they found a way to make up for it with software or even hardware, you could probably do something much more powerful than that to get it on the market. This angle thing has been a dilemma for the major projector manufacturers in the market for years. As they themselves mention on the page, they don’t have prototype yet. Once they have it, we can examine it better ;)

  • 1

    @Bacco, my fear is that this is all a scam. Because they ask for donations to the direct prototype in a paypal account (instead of something like Kickstarter). And the whole project seems too absurd to me, in many points.

  • 1

    @Guilhermebernal I swear that I had not read the comments before writing my answers, but I agree with you, I also think it’s a scam. I still intend to update my reply with more images, other explanations and facts.

3 answers

26


That sounds more like a job for Mythbusters, but I’ll take my chances on an answer.

About the video

The video seems to me clearly a montage.

It sure is. But until then nothing wrong with that.

Suppose a company has an idea and thinks it will sell millions, then after some research this company concludes that the project is viable and start development. However as in many of the times these ideas start from small startups they have no money to invest, so what they do is a promotional video to make it very clear what their idea is and advertise behind investors who decide to bet on the idea.

Similarly, in stands sale of apartment in condominiums, there are models, which do not intend to be prototypes, but aims to illustrate the idea of the construction.

Who would be the investors?

There is a site called Kickstarter. He’s an example of a very interesting idea, called crowdfunding. Crowdfunding is a derivation of crowdsourcing, where an organization uses the talent and time of hundreds, thousands or millions of people to create or improve a product or a service. Source: Team. Wikipedia is a beautiful example of a crowdsourcing.

Similarly, Kickstarter uses crowdfunding to pay for creative projects requesting small donations from crowd, in free translation, from populace, who are anonymous investors visitors to the site.

A case of "success"

A project that became very famous in Kickstarter was the Mighty Mug, that promised to make a mug that never tipped, ideal for clumsy.

They even made some prototypes and the video went live on Youtube. Their initial goal of raising $10,000 ($10,000) was exceeded more than 10 times. Yes, they got over $100,000 (one hundred thousand dollars) from over 2,000 people who also bet on the product.

A success!! Or maybe not...

All that glitters is not gold

About a month ago the mugs started to be sent to investors, and the problems began to arise, were since lack of tracking number of shipments, mailings to wrong addresses and the worst of all: the product did not meet expectations.

See one of several investor complaints comments after receiving the product:

I will NEVER support a Kickstarter project Ever after this Experience with Mighty Mug. I Finally get a product that is defective. The top Leaks so bad that any Liquid just pours out. USELESS! No Response from Jayme and no help from Kickstarter.

In free translation:

I will NEVER support another Kickstarter project again after this experience with Mighty Mug. I finally got my product, but it’s defective. The top slot is so bad that any liquid leaks out. USELESS. No response from Jayme (the founder) and no help from Kickstarter.

Author: Someone very angry who invested in Mighty Mug.

Link: Investor comments.

Unfortunately, so far the product has not worked very well.

Where’s the bracelet in Kickstarter?

That’s it. She’s not in Kickstarter because it’s not a crowdfunding. The company is not offering or promising prototypes, it is only collecting donations.

The only thing they say is that the bracelet can be developed if they raise an amount of €700,000.00 (seven hundred thousand euros), which is equivalent to about R$2,300,000.00 (two million and three hundred thousand reais), in today’s quotation.

The company’s only promise, and it has already been fulfilled, is that the bundles of donors will have their names displayed on a hall of fame, which is nothing more than a list of names in a table tosssima on one of their website pages.

But... what if they raise the money and can’t even develop a prototype? Well, I don’t see written down anywhere the warranty on the prototype, and as much as it exists one day, it will be owned by the company, not the donors.

Technical implications of bracelet development

1. Streaming

Streaming in itself will probably be the least of your problems, because the same way you can connect your phone to an HDMI and view your screen on a TV, you can very well send the screen image to another output other than the data cable.

My assessment of the requirement: Superable.

Problem 1: Security

Security can be a problem in this situation, as doing streaming from the screen through third party devices may allow it to store images while you type passwords on the virtual keyboard.

It is not enough to be a deterrent, because in the same way that we entrust our data to cell phone manufacturers we would have to entrust our data to the manufacturer of the bracelet, but it is an extra concern that we should have.

My assessment of the problem: Superable.

2. Projection

Image projection is nothing new to us, but not like this. I can list some problems I thought:

Problem 2: The angle of incidence of the projected light is very inclined

luz incidindo muito inclinada

This means that the part of the arm that is closest to the projector will receive much more light than the rest of the arm, which would make the image strong near the projector and weak away from it.

Furthermore, the image would be projected at different distances, which means that we would need a multi-focal projector lens to focus both near and far at the same time. Thing that doesn’t exist today.

My assessment of the problem: Impeditive. I believe there is no solution to this.

Problem 3: The projection angle may vary

angulo variando

If the bracelet is too wide, too tight, or simply moves around the arm, it implies that the angle of the projection must accompany these movements, and this involves many proximity sensors and many adjustments to the projection. Something that in my view is completely unfeasible.

My assessment of the problem: Impeditive. I believe there is no solution to this.

Problem 4: Lens is very close to projection

That means two things:

4.1. The angle of the lens aperture has to be very large;

In order to be able to project at short distances, the lens aperture must be very large.

In the frame, a "Super Wide Angle" lens provides an aperture of up to 95º. The "Fish Eye" lenses capture images at an angle that can be up to 180º. Source: Techtudo: Learn the meaning of the acronyms and numbers of the lens aperture

But everybody knows how the picture looks It’s not even?

olho de peixe

Let’s calculate the lens opening of the supposed bracelet. Based on the video images, consider that the distance of 1 cm from the projector to the projection, and that the width of the projection is 4 cm.

distancias da projeção

resulting in the following calculation:

Opposite cathode = 4 cm / 2 = 2 cm
Adjacent cathode = 1cm

Tg = opposite cathode / adjacent cathode; hence:

Tg α = 2/1 α 65º

Therefore, the aperture of the projector lens should be about 130º. That would leave the screen with a very strange appearance, similar to the fish eye photo.

4.2. The lens must be able to focus at very short distances.

To focus at short distances, the lens needs to close the diaphragm tightly, but closing the diaphragm implies a decrease in the angle of the lens aperture, which means that items 4.1 and 4.2 are conflicting, and consequently, it is not possible to have both simultaneously. Source: Shooting Mania: How to do a macro photograph? Tips for shooting macro

My assessment of the problem: Impeditive. I believe there is no solution to this.

Problem #5: The surface of our arm is not flat

Our arm looks nothing like a wall, where projections usually occur. The irregularities of the surface of our arm could cause shadows in the projection of the image to completely distorted images.

Would anyone have the patience to read whole texts that look more like Captchas infinite?

My assessment of the problem: Gravissímo. Not worth the investment.

Problem #6: Projectors usually work well in the dark

The projectors that we are used to seeing in classrooms and meetings, need little light competing with their lighting, otherwise the projection is almost invisible. In the case of a micro projector the trend is only worse, since the lamp power tends to be lower.

My assessment of the problem: Device would restrict itself basically to indoor environments with very little lighting. It would lose a lot of market with this making its production practically unviable.

Problem 7: The image will be cropped when your finger touches your arm

dedo cobrindo projeção

(Image representing problems 6 and 7 together)

Quite different from the release video, no?

My assessment of the problem: You can live with it. But the application would lose much of its charm and become much less attractive than the video suggests.

3. Gestures

If we are ever concerned about this, it is because we have solved all the previous problems. So just as the bracelet would be smart enough to project a flat image under such adverse circumstances, it would have enough sensors to be able to identify where an object interfered with the projection with a sharp enough angle on the surface to be considered a touch on the "screen".

My assessment of the requirement: Superable.

4. Root

Or it would be a solution only for devices with root and that have been modified in some way?

If this product were actually manufactured, I would say that if root was a must, it would be a problem that wouldn’t last long. We can assume that this product would be so revolutionary that the companies that develop mobile operating systems would do anything to facilitate compatibility with their devices, and possibly even partner to sell cell phone combos that already accompany such a bracelet.

Therefore, I would say that this concern per hour is irrelevant.

My assessment of the requirement: Superable.

Completion

The following points are highlighted:

  • There are numerous difficulties in the development of the project, some that I think would make the project unviable;
  • Nothing that legally guarantees that the company will use the money raised in the product development.

Without wishing to doubt anyone’s suitability, I would just like to conclude that someone malicious can make a lot of money on top of promises and no legal obligation and commitments.

My verdict is:

mito detonado

  • I meant that that projection is generous, because despite showing the obstruction, the unobstructed part has dark regions, which would be impossible in reality. A projector can only go from the color of the skin to lighter. There is nothing like "beam light", except in cartoon.

  • Oh yes, I understand now. I am taking note of all your comments, I think my answer will increase well in size! rs..

  • @Bacco actually I only cut part of the projection, the rest who did was the company itself

  • I know that. I just commented that you were generous in not fixing this other defect, because in the real world it would be much worse.

  • 6

    I’m raising funds to build a "light generator," @Bacco. Those who want to collaborate can contribute Bitcoins posted in comments here at Sopt.

  • 4

    @bfavaretto enjoy and make a solid/perpetual bike to power the blackout lamp :D

  • 2

    In good lighting conditions, and with a "hyper-intense projector ™", you could hardly get there: http://i.stack.Imgur.com/Evfkt.jpg DETAIL: If you count the curvature of the arm, you will see that the lens position would not allow such a large image. At this same size, the arm itself would obstruct the 4 nozzles of the image.

  • @Trouble that never ends! We still need to talk about the dark light, the intensity of the light and the hair, although the hair can be used the argument that you can use the bracelet to the inside of the arm, where there are not so many of them. And besides, I can think of several other ways to bring down this myth, such as drums, and others related to a super fantastic lens that doesn’t even exist in Jupiter, rs.. But my next steps are the fountains and the images.

  • @Bacco yes, there is a part of the video that the guy zoom the map, but one finger is covering the other projection, I thought to take this image to edit and use in the answer.

  • 1

    @Bacco thanks for the edited image! saved me a nice one from a job :)

  • 2

    Haha! This "BROKEN MYTH" caught my attention! Good reviews! Really the idea of the finger on the screen (Mounting which by the way got very good!) cutting the screen had not imagined. Congratulations!

Show 6 more comments

7

Emulating events of touch

inserir a descrição da imagem aqui

in this image above I called the developer mode "show pointer location", note the position coordinates being shown, it would be perfectly possible to use information like this for emulation of ringtones.

Yes, it is possible, because as you can see in this question there are ways to simulate events Esture¹ on android, so there are apps like this that set actions for certain events, these actions can be listened to by installed applications as a service on android, because these apps run on background on your device, and use Gesturelistener’s to capture your movements on the device.

As for the streaming part:

inserir a descrição da imagem aqui

As you spoke of Teamviewer, as it is, he himself has a solution for this, that would be the mobile device support, so you can understand that even without root, you can have streaming from the device screen.

Now the question of "remote"

Well, most applications that send commands to the device need root, but there are means like SMS Tasks that you can send sms to your device and it recognize the string and perform tasks through this, but the performance is very low, similarly, there are some applications that control actions on the mobile via wifi, such as Airdroid, but I believe that the Teamviewer is best suited to be based on this question because he has the computer mouse as the point where you can perform all unique touch events, as for multiples, I do not know for sure, but from there it is possible to base and have a start to a future different implementation.

Proximity sensor(touch sensor)

calculo da posição da proximidade

Well, in the case of Cicret it uses 8 long proximity sensors that capture the presence and send to the processor that uses the wifi card to send the commands to the device, as you can see here but I believe that Arduino is involved in this scheme, because with Arduino it is possible to implement proximity sensors.

Projection(e.g. Data Show)

The cicret uses the projector peak to perform the streaming projection, so we can believe it’s true, but I believe it doesn’t have as much video quality as it looks, because of the light, maybe in a dark environment yes, but in a clear environment it is hard to believe that this works well, but you can see here something about the peak and how it can work.

Completion

Well, in short, there are now all these technologies mentioned above, but I believe that the only one that involves all this in one device, would be this cicret, it is worth getting to the bottom of this, if you seek to understand how it works, because it is something innovative and very interesting, hope I’ve helped.

¹: "Gesture" means gestures, which is the main object of control of events involving touch in the form of gestures, movements, on android.

    1. The question shows how to create a touch event, but it is injected by this API: view.dispatchTouchEvent(motionEvent);, that is: you need to have a target view, you cannot inject a global event or even outside your own application. | 2. The application Hovering Controls Free (watch the video) does not create ringtones. It at most opens apps. But it seems to have a version that uses something with ROOT to control add gestures in other applications. This may be a start.
  • 1
    1. About streaming the video, I tested their solution and it is not something global (see comment in the other reply). 4. The projector peak is interesting, but even it only works well in the dark. I mean.. how this bracelet will project black on the person’s skin?
  • Because it’s @Guilhermebernal with root everything gets easier(from a functional point of view) but just as the application captures your movement it can instead of opening an application, it can dispatch the very action you executed, you understand?

  • @Guilhermebernal Teamviewer is yes, it is a remote connection, it has the part of screenshot and such but it has the option of you to control directly and use the mouse to click on things etc.. I and a few others from the company already used

  • But how? At code level

  • Now about the peak, as I told you, in the absence of light is perfect, but I do not know if it has real ability to emit in light environments, now black came to me as something almost impossible, as a denial of light rays (something well beyond current technology) but who knows he can, I didn’t dig deep on him

  • 1

    If I can make an app that is a service that injects the device and captures the screen at will, then I can perfectly open the user’s database application and transfer everything to my account while it is not looking. Do you understand? An application that is able to control others is a huge security breach.

  • You know the android.permission ? then, when you install an application on your device, it shows EVERYTHING IT CAN DO in the case, and in some cases shows in evidence that it can be even dangerous, gives several alerts and such but in fact it is you who accepts to install the application or not, however there are some cases that android finds too dangerous and blocks, hence would come the root throughout this story.

  • Probably this cicret will need a lot of papers and licenses and authorizations and permissions android to be able to install and work rootless

  • @Guilhermebernal doesn’t have access to the application’s source code so we don’t know exactly at code level how to implement this function, but we know that it is possible, as programmers, we understand that if it is possible to capture an event and identify itIt and classify it we can also perform it. This context was based on a statement that "it is possible" answering this your question.

  • 2

    Teamviewer’s Quicksupport actually has remote control, but requires root to work. Other than that, there seems to be no way. No android permission allows this level of access and no public API allows you to inject taps or capture screens outside the app. So the only way this bracelet would work would be root? If not, how would the implementation of this?

  • To say that "no permission from android allows this level of access" sounds kind of frivolous, you know of course I believe not, but I believe that there are alternative means for this, maybe not a "normal" permission or maybe a differentiated permission that would be exclusive for this purpose, because I believe that on top of all this work of marketing cicret they should be aware along with android that there is a exclusive permission for the application itself. After all, we understand that in programming everything is possible (until proven otherwise).

  • 2

    I tested here and found that Teamviewer Quicksupport only has support for some manufacturers (http://www.teamviewer.com/pt/help/341-How-can-I-control-my-Android-device-with-TeamViewer.aspx), which should probably give permissions for this type tool, but already on Android "Pure" (Like the Nexus and Motorola line), I could not use. According to Techtudo (http://www.techtudo.com.br/noticias/noticia/2014/11/android-50-vai-permit-gravar-videos-da-tela-do-celular-sem-root.html), the idea of Google is to allow screen recordings, which may enable an application to use this feature.

  • 1

    It is worth remembering that such a feature, in my opinion, is a good device security flaw, integrate to the developers a tool as powerful as this. Not even recording links Android has (discontinued since version 2.3). Only through root.

Show 9 more comments

1

To answer your question:

If this is possible, why companies like Teamviewer have not yet made a remote control client for Android?

Yes there is client to access Android devices, made by Teamviewer itself.

"With Teamviewer’s mobile device support for Android, you control mobile devices remotely¹ and can see exactly what the user of the device is seeing. Other features include: enhanced view of the control panel, possibility to terminate processes remotely on the mobile device and recovery of files from Android device."

Source Teamviewer.

  • I tested their system and by default there is no screen sharing or remote control of any kind. Quicksupport sends data from the device to the "controller" and this can communicate with the user through a chat. Screenshots can be sent, but manually, by the user on the phone. As for the mentioned real-time sharing, it is a library to be incorporated into third-party applications. That is: it is a code embedded in the application itself so that it actively sends its own screens. Can’t get anything out since app

  • 1

    AI that you are wrong, can yes, and even beyond Teamviewer has Airdroid that allows you to control on the computer the screen of the mobile phone

  • Friend @Lucasmotta, Airdroid does not control the screen of the phone, only the management of files and peripherals of Android, in which there are already permissions available to developers. Also, the "Screenshot" option only works with root. Already the Teamviewer, see my comment

  • @biio, ever used? I’ve used and seen using, You can control the screen of the phone by computer. Including to access all applications including the camera. It’s like a remote windows desktop connection.

  • Ah, sorry for the @Meuchapeu misconception, my phone is Nexus 5 and is in Lollipop version 5.0, which is incompatible with Airmirror tool. Probably in other versions it can be compatible!

  • Both Airdroid and Teamviewer allow you to fully control your mobile screen... Not by screen capture or by chat, but by screen sharing, by remote access

  • Not being compatible with Android "Pure", becomes a tool, let’s say, limited. Today I downloaded the application "Screen Recorder", which is only compatible with Lollipop. We can see great advances in relation to this.

Show 2 more comments

Browser other questions tagged

You are not signed in. Login or sign up in order to post.