The verification of electoral procedures and results is a matter which, up to now, has been related only to countries of recent democratization. Institutions of western democracies have guaranteed the required checks over every aspect of elections avoiding the need of international observers.
Several international organizations verify electoral procedures and results in risky countries. Among them are the following organizations: OSCE, European Commission and UN. Their observers verify the whole electoral mechanism:

• that nobody is excluded from the rigth to vote
• that electors are really given the possibility to vote
• that there are no improper pressures on electors
• that electoral procedures are properly executed ad every level
• that results are properly counted

But if a country ruled by a dictator, or a country of a recent democracy, would use e-vote could any international organization check the electoral process and certify its results? Surely not! That's why

1. Dictators should spend a bit of the money they steal from their people in implementing electronic electoral systems rather than saving it in their private bank accounts
2. we really should worry because we have the proof that even our e-election are unverifiable. Of course we can still ingenuosly rely on the honesty of our estabilshment, but we should not forget that democracy ends when electoral results are not verifiable