[guardian-dev] Let's pick a real-world emulator for our app testing

[Stephen Lombardo]

Hi Mark,

Here is one more you might add to the list for consideration:

http://xamarin.com/test-cloud

I was at the Evolve conference last week and they did a demo of system, and
it looks incredible with multiple options for test scripting, auto
discovery, Jenkins integration, screenshots of failures, performance
reports, and a wide number of supported devices. It's still in beta, but I
think it stands to be a strong option in the space.

Cheers,
Stephen



On Wed, Apr 24, 2013 at 11:33 AM, Mark Belinsky
<mark at guardianproject.info>wrote:

> There are so many types of Android devices out there! How do we test our
> apps on all of them? Well, there  are services where a bunch of physical
> and/or emulated devices are hosted and accessible. Question is, which one
> should we go with? Anyone have experience with which ones are good, bad and
> ugly?
>
> Here's a break down of those that I've found with a cost and performance
> breakdown:
>
> Real devices:
> * TestDroid
> @ https://cloud.testdroid.com/
> @ * Pay as you go: $0.99/device run. Across 200+ devices
> @ * Premium: $1500/month. Unlimited test runs on max 3 projects. Top
> priority. API into build systems.
> @ * Enterprise: waiting on response
> * Appthwack
> @ * https://appthwack.com/ (pretty site!)
> @ * Hobbyist: $29/month. Across top 10 devices. Unlimited runs. 1 user. 1
> project. (including GS3)
> @ * Indie: $99/month. Across top 25 devices. Unlimited runs. 1 user. 1
> project.
> @ * Pro: $299/month. Across top 180+ devices. Unlimited runs. 1 user. 1
> project. (150 phones / 33 tablets)
> * Perfecto
> @ * http://www.perfectomobile.com/portal/cms/pricing/
> @ * Per Project: $25/hr. Across 100 handsets and tablets
> @ * Subscription: $15-$10/hr. Across 1500 handsets and tablets
> * DeviceAnywhere (ugly)
> @ *
> http://www.keynotedeviceanywhere.com/mobile-application-testing-overview.html
> @ * Monthly: $100/month. $15-$18/hr testing.
> * TestCloud
> @ * https://www.thetestcloud.com/
> @ * Requested an offer. Integration into redmine.
> Emulator:
> * TestObject - http://www.testobject.com/continuous.html - currently in
> beta.
>
> From some Googling for articles, it seems that TestDroid is the most
> trusted with Appthwack being an up and comer. Given that TestDroid can
> connect directly into a Jenkins build server, this seems like an awesome
> opportunity for us. However, at the $1500/month price point, it could push
> us into Appthwack land if we don't want to take that hit.
>
> Best,
> Mark
>
> --*
> @mbelinsky <https://twitter.com/mbelinsky> | guardianproject.info |
> phone: +1-347-466-9327 | ostel: 1003 **| pgp: 0xEFBFA7278D8EFFDA<http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xEFBFA7278D8EFFDA>
> *
>
> _______________________________________________
> Guardian-dev mailing list
>
> Post: Guardian-dev at lists.mayfirst.org
> List info: https://lists.mayfirst.org/mailman/listinfo/guardian-dev
>
> To Unsubscribe
>         Send email to:  Guardian-dev-unsubscribe at lists.mayfirst.org
>         Or visit:
> https://lists.mayfirst.org/mailman/options/guardian-dev/sjlombardo%40zetetic.net
>
> You are subscribed as: sjlombardo at zetetic.net
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mayfirst.org/pipermail/guardian-dev/attachments/20130424/bc11bb30/attachment.html>