P2A a tool for converting pixels to animated mobile application user interfaces

Developing mobile applications is typically a labor-intensive process in which software engineers manually re-implement in code screen designs, inter-screen transitions, and in-screen animations developed by user interface and user experience experts. Other engineering domains have used computer vis...

Full description

Saved in:
Bibliographic Details
Published in:2018 IEEE ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft) pp. 224 - 235
Main Authors: Natarajan, Siva, Csallner, Christoph
Format: Conference Proceeding
Language:English
Published: New York, NY, USA ACM 27.05.2018
Series:ACM Conferences
Subjects:
Animation
Facebook
Human-centered computing > Human computer interaction (HCI) > Interactive systems and tools > User interface programming
Human-centered computing > Ubiquitous and mobile computing > Ubiquitous and mobile computing design and evaluation methods
Mobile applications
Mobile software engineering
pixel based design
Prototypes
Smart phones
Software and its engineering > Software notations and tools > Compilers > Source code generation
Software and its engineering > Software notations and tools > Development frameworks and environments > Integrated and visual development environments
User interfaces
pixel-based design
mobile software engineering
ISBN:9781450357128, 1450357121
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Developing mobile applications is typically a labor-intensive process in which software engineers manually re-implement in code screen designs, inter-screen transitions, and in-screen animations developed by user interface and user experience experts. Other engineering domains have used computer vision techniques to automate human perception and manual data entry tasks. The P2A tool adopts computer vision techniques for developing animated mobile applications. P2A infers from mobile application screen designs the user interface portion of an application's source code and other assets that are ready to be compiled and executed on a mobile phone. Among others, inferred mobile applications contain inter-screen transitions and in-screen animations. In our experiments on screenshots of 30 highly-ranked third-party Android applications, the P2A-generated application user interfaces exhibited high pixel-to-pixel similarity with their input screenshots. P2A took an average of 26 seconds to infer in-screen animations.
ISBN:9781450357128
1450357121
DOI:10.1145/3197231.3197249