P2A a tool for converting pixels to animated mobile application user interfaces

Developing mobile applications is typically a labor-intensive process in which software engineers manually re-implement in code screen designs, inter-screen transitions, and in-screen animations developed by user interface and user experience experts. Other engineering domains have used computer vis...

Full description

Saved in:
Bibliographic Details
Published in:2018 IEEE ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft) pp. 224 - 235
Main Authors: Natarajan, Siva, Csallner, Christoph
Format: Conference Proceeding
Language:English
Published: New York, NY, USA ACM 27.05.2018
Series:ACM Conferences
Subjects:
ISBN:9781450357128, 1450357121
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Developing mobile applications is typically a labor-intensive process in which software engineers manually re-implement in code screen designs, inter-screen transitions, and in-screen animations developed by user interface and user experience experts. Other engineering domains have used computer vision techniques to automate human perception and manual data entry tasks. The P2A tool adopts computer vision techniques for developing animated mobile applications. P2A infers from mobile application screen designs the user interface portion of an application's source code and other assets that are ready to be compiled and executed on a mobile phone. Among others, inferred mobile applications contain inter-screen transitions and in-screen animations. In our experiments on screenshots of 30 highly-ranked third-party Android applications, the P2A-generated application user interfaces exhibited high pixel-to-pixel similarity with their input screenshots. P2A took an average of 26 seconds to infer in-screen animations.
AbstractList Developing mobile applications is typically a labor-intensive process in which software engineers manually re-implement in code screen designs, inter-screen transitions, and in-screen animations developed by user interface and user experience experts. Other engineering domains have used computer vision techniques to automate human perception and manual data entry tasks. The P2A tool adopts computer vision techniques for developing animated mobile applications. P2A infers from mobile application screen designs the user interface portion of an application's source code and other assets that are ready to be compiled and executed on a mobile phone. Among others, inferred mobile applications contain inter-screen transitions and in-screen animations. In our experiments on screenshots of 30 highly-ranked third-party Android applications, the P2A-generated application user interfaces exhibited high pixel-to-pixel similarity with their input screenshots. P2A took an average of 26 seconds to infer in-screen animations.
Author Csallner, Christoph
Natarajan, Siva
Author_xml – sequence: 1
  givenname: Siva
  surname: Natarajan
  fullname: Natarajan, Siva
  email: siva.natarajan@mavs.uta.edu
  organization: The University of Texas at Arlington
– sequence: 2
  givenname: Christoph
  surname: Csallner
  fullname: Csallner, Christoph
  email: csallner@uta.edu
  organization: The University of Texas at Arlington
BookMark eNqNjz1PwzAQho0KElAyM_AHWBLu_HG2x6qCglQJBpgtOz5LAdqghIV_T6CZmNANr07Pq1d6zsXxvt-zEJcIDaI2Nwq9lQqb39T-SFTeugmAMhalW_z5T0U1jq8AIMkZK_FMLJ7k6kKclPg-cjXnUrzc3T6v7-vt4-ZhvdrWUWr7Wdts2HtPklK0KVEqXrGXxlJpITNMp8G6bAA0oTJtS5CpRHKMMfukluLqsNsxc_gYul0cvoIzWmnjJnp9oLHdhdT3b2NACD-WYbYMs-VUbf5ZDWnouKhv89tNjQ
CODEN IEEPAD
ContentType Conference Proceeding
Copyright 2018 ACM
Copyright_xml – notice: 2018 ACM
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1145/3197231.3197249
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 9781450357128
1450357121
EndPage 235
ExternalDocumentID 8543458
Genre orig-research
GroupedDBID 6IE
6IF
6IL
6IN
AAJGR
ABLEC
ACM
ADPZR
ALMA_UNASSIGNED_HOLDINGS
APO
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
GUFHI
IEGSK
OCL
RIB
RIC
RIE
RIL
AAWTH
LHSKQ
ID FETCH-LOGICAL-a247t-7d5e999626ba7bb6bf93e92576fc0de0e0e4078d50046135cc60d6fa68e1ad9b3
IEDL.DBID RIE
ISBN 9781450357128
1450357121
ISICitedReferencesCount 9
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000454503200035&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:51:04 EDT 2025
Wed Jan 31 06:52:50 EST 2024
Wed Jan 31 06:52:08 EST 2024
IsPeerReviewed false
IsScholarly true
Keywords pixel-based design
mobile software engineering
Language English
License Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Permissions@acm.org
LinkModel DirectLink
MeetingName ICSE '18: 40th International Conference on Software Engineering
MergedId FETCHMERGED-LOGICAL-a247t-7d5e999626ba7bb6bf93e92576fc0de0e0e4078d50046135cc60d6fa68e1ad9b3
PageCount 12
ParticipantIDs acm_books_10_1145_3197231_3197249
ieee_primary_8543458
acm_books_10_1145_3197231_3197249_brief
PublicationCentury 2000
PublicationDate 20180527
2018-May
PublicationDateYYYYMMDD 2018-05-27
2018-05-01
PublicationDate_xml – month: 05
  year: 2018
  text: 20180527
  day: 27
PublicationDecade 2010
PublicationPlace New York, NY, USA
PublicationPlace_xml – name: New York, NY, USA
PublicationSeriesTitle ACM Conferences
PublicationTitle 2018 IEEE ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft)
PublicationTitleAbbrev MOBILESoft
PublicationYear 2018
Publisher ACM
Publisher_xml – name: ACM
SSID ssj0002685721
Score 2.1245089
Snippet Developing mobile applications is typically a labor-intensive process in which software engineers manually re-implement in code screen designs, inter-screen...
SourceID ieee
acm
SourceType Publisher
StartPage 224
SubjectTerms Animation
Facebook
Human-centered computing -- Human computer interaction (HCI) -- Interactive systems and tools -- User interface programming
Human-centered computing -- Ubiquitous and mobile computing -- Ubiquitous and mobile computing design and evaluation methods
Mobile applications
Mobile software engineering
pixel based design
Prototypes
Smart phones
Software and its engineering -- Software notations and tools -- Compilers -- Source code generation
Software and its engineering -- Software notations and tools -- Development frameworks and environments -- Integrated and visual development environments
User interfaces
Subtitle a tool for converting pixels to animated mobile application user interfaces
Title P2A
URI https://ieeexplore.ieee.org/document/8543458
WOSCitedRecordID wos000454503200035&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8NAEB7a4sFT1VasL1YQvJg2r91svIVi8WLJoYXewr4iAU2kTcWf7-4mtgiCSA4JIRCY7Ga-b2a-GYBbn2lMQALm-CGOnFAqV28pHjvaWygcuIISzO2wiWg-p6tVnHbgfqeFUUrZ4jM1Npc2ly8rsTWhsgk1OkhMu9CNItJotXbxFJ9QrNlM273HC_EksBO1vLE9m16ZXSbefgxRsT5k1v_f249guBfjoXTnZo6ho8oT6H9PY0Dt5hxAmvrJA0rQoqpekYaiaGoKyk2TgBeUFp_aB6K6QklZaIyqJHquuP4hoGSfwEZLvRyRDRHmplBrCMvZ42L65LTzEhzmh1HtRBIrw198wlnEOeF5HKjYMIpcuPor6MNk7SQ2pNgLsBDElSRnhCqPyZgHp9Arq1KdAeI0zLHgRFBBNSdS1PM4jYWPpUY0jOMR3GhjZoYIbLJG24yz1uBZa_AR3P35TMbXhcpHMDDmzt6bBhtZa-nz329fwKFGLbSpOryEXr3eqis4EB91sVlf21XxBchIskw
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NS8NAEB3aKuipaivWzxUEL6bN12423oJYKrYlhxZ6C9nNRgKaSJuKP9_dTWwRBJEcEkIgMNnNvDczbwbgxo4lJiBObNgu9gw3EabcUsw3pLcQ2DE5JZjpYRPedEoXCz9swN1GCyOE0MVnoq8udS4_KfhahcoGVOkgMW3CDnZd26zUWpuIik0olnym7t9juXjg6JlaVl-fVbfMZszffoxR0V5k2P7f-w-gu5XjoXDjaA6hIfIjaH_PY0D19uxAGNrBPQrQrChekQSj6EGVlKs2AS8ozD6lF0RlgYI8kyhVJGhSMPlLQME2hY3mckEiHSRMValWF-bDx9nDyKgnJhix7Xql4SVYKAZjExZ7jBGW-o7wFadIuSm_gzxU3i7BihZbDuacmAlJY0KFFSc-c46hlRe5OAHEqJtizginnEpWJKhlMepzGycS08QM9-BaGjNSVGAVVepmHNUGj2qD9-D2z2citsxE2oOOMnf0XrXYiGpLn_5--wr2RrPJOBo_TZ_PYF9iGFrVIJ5Dq1yuxQXs8o8yWy0v9Qr5Aj72tZM
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+5th+International+Conference+on+Mobile+Software+Engineering+and+Systems&rft.atitle=P2A&rft.au=Natarajan%2C+Siva&rft.au=Csallner%2C+Christoph&rft.series=ACM+Conferences&rft.date=2018-05-27&rft.pub=ACM&rft.isbn=9781450357128&rft.spage=224&rft.epage=235&rft_id=info:doi/10.1145%2F3197231.3197249
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450357128/lc.gif&client=summon&freeimage=true
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450357128/mc.gif&client=summon&freeimage=true
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450357128/sc.gif&client=summon&freeimage=true