Sage Journals: Discover world-class research

Abstract

Android systems typically run on resource-constrained hand-hold devices. How to efficiently utilize Java heaps is one of the most important issues of concerns to the developers. Developers often use profilers to observe the utilization efficiency of Java objects, hoping to find out memory allocation bottlenecks, identify and solve problems such as memory leaks, etc. However, currently there lacks a low-overhead and efficient Java object profiler on Android and its Java virtual machines.

In this paper, we design and implement a novel and low-overhead Java object profiler based on the Address-Chain technique, on Android 6.0 and its ART virtual machine, which uses an AOT (ahead-of-time) compiler and has complex garbage collection algorithms. Our profiler records the allocation site, the class information of the object, the object size, the birth time and death time of the object, the physical memory trace of the object movements with time stamps, the last access time and the access regular pattern, etc., for every Java object. The data profiled can help the developers to detect memory leaks, implement optimizations like pretenuring and tune the performance of garbage collector, etc.

The Java object profiling mechanism proposed in this paper has low execution time overhead, imposes no overhead on the Java heap and does not modify any existing key data structure of the ART Virtual Machine, including the object layouts, class layouts and any others. By caching object access event in global register and removing redundant instrumentation, on Nexus7 and Android 6.0, the read/write barriers overheads of the profiler are about 19% on average for EEMBC, SciMark and other workloads. The I/O overheads are about 28% and the total execution overheads are about 51% on average.

Keywords

Low-overhead profiler android managed languages object lifetime information

Get full access to this article

View all access options for this article.

References

Ali-Gombe ,

Ahmed , Richard

G.G.

III , et alAspect-Droid: Android App Analysis System[C], Proceedings of the Sixth ACM Conference on Data and Application Security and Privacy, ACM, (2016), pp. 145–147.

D.F.

Bacon ,

Cheng and

V.T.

Rajan , A real-time garbage collector with low overhead and consistent utilization[J], ACM SIGPLAN Notices38(1) (2003), 285–298.

S.M.

Blackburn ,

Hertz ,

K.S.

Mckinley et al., Profile-based pretenuring[J], ACM Transactions on Programming Languages and Systems (TOPLAS)29(1) (2007), 2.

Blackshear ,

B.Y.E.

Chang and

Sridharan , Thresher: Precise refutations for heap reachability[C], ACM SIGPLAN Notices ACM.48(6) (2013), 275–286.

M.D.

Bond and

K.S.

McKinley , Bell: bit-encoding online memory leak detection[J], ACM SIGOPS Operating Systems Review40(5) (2006), 61–72.

M.D.

Bond and

K.S.

McKinley , Tolerating memory leaks[C], ACM Sigplan Notices ACM43(10) (2008), 109–126.

M.D.

Bond and

K.S.

McKinley , Leak pruning[C], ACM SIGARCH Computer Architecture News, ACM37(1) (2009), 277–288.

Briggs and

K.D.

Cooper , Effective partial redundancy elimination[C],ACM SIGPLAN Notices, ACM29(6) (1994), 159–170.

Bu ,

Borkar ,

Xu et al., A bloat-aware design for big data applications[C], ACM SIGPLAN Notices, ACM48(11) (2013), 119–130.

10.

CaffeineMark 3.0 [Online]. Available:, .

11.

K.C.

Chang ,

C.Y.

Kao ,

Y.S.

Chen et al., Memory behavior profiler for Android applications[C], 2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE). IEEE, (2014), pp. 634–635.

12.

Couto ,

CarÃğao

Cunha , et al., Detecting anomalous energy consumption in android applications[C], Brazilian Symposium on Programming Languages, Springer International Publishing, (2014), pp. 77–91.

13.

DeltaBlue [Online]. Available: https://github.com/xxgreg/ deltablue

14.

EEMBC [Online]. Available:, .

15.

Fang ,

Dou and

Xu , Perfblower: Quickly detecting memory-related performance problems via amplification[C], LIPIcs-Leibniz International Proceedings in Informatics. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik2015, 37.

16.

Hertz ,

S.M.

Blackburn ,

J.E.B.

Moss et al., Generating object lifetime traces with Merlin[J], ACM Transactions on Programming Languages and Systems (TOPLAS)28(3) (2006), 476–516.

17.

HPROF Viewer 2016. [Online]. Available: https://developer.android.com/studio/profile/am-hprof.html

18.

Huang ,

Dong ,

Milanova et al., Scalable and precise taint analysis for android[C], Proceedings of the 2015 International Symposium on Software Testing and Analysis, ACM2015, 106–117.

19.

JProbe 2016. [Online]. Available: https://marketplace.eclipse.org/content/jprobe

20.

Jprofiler 2016. [Online]. Available:https://www.ej-technologies.com/products/jprofiler/overview.html

21.

Jung ,

Lee ,

Raman et al., Automated memory leak detection for production use[C], Proceedings of the 36th International Conference on Software Engineering, ACM2014, pp. 825–836.

22.

Lee ,

Jung and

Pande , Detecting memory leaks through introspective dynamic behavior modelling using machine learning[C], Proceedings of the 36th International Conference on Software Engineering, ACM2014, pp. 814–824.

23.

Lim ,

Lee and

Won , Androtrace: framework for tracing and analyzing IOs on Android[C], Proceedings of the 3rd Workshop on Interactions of NVM/FLASH with Operating Systems and Workloads, ACM2015, p. 3.

24.

Marinov and

O’Callahan , Object equality profiling[C], ACM SIGPLAN Notices, ACM8(11) (2003), 313–325.

25.

Mitchell ,

Schonberg and

Sevitsky , Four trends leading to Java runtime bloat[J], IEEE software27(1) (2010), 56.

26.

Mitchell and

Sevitsky , The causes of bloat, the limits of health[C], ACM SIGPLAN Notices, ACM42(10) (2007), 245–260.

27.

Mytkowicz ,

Diwan ,

Hauswirth et al., Evaluating the accuracy of Java profilers[J], ACM Sigplan Notices45(6) (2010), 187–197.

28.

Nguyen ,

Wang ,

Bu et al., Facade: A compiler and runtime for (almost) object-bounded big data applications[C], ACM Sigplan Notices ACM, 50(4) (2015), 675–690.

29.

Novark ,

E.D.

Berger and

B.G.

Zorn , Efficiently and precisely locating memory leaks and bloat[J], ACM Sigplan Notices44(6) (2009), 397–407.

30.

Odaira ,

Ogata ,

Kawachiya et al., Efficient runtime tracking of allocation sites in Java[C], Acm Sigplan Notices, ACM45(7) (2010), 109–120.

31.

Odaira and

Nakatani , Continuous object access profiling and optimizations to overcome the memory wall and bloat[J], ACM SIGARCH Computer Architecture News40(1) (2012), 147–158.

32.

Rayside and

Mendel , Object ownership profiling: A technique for finding and fixing memory leaks[C], Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, ACM2007, pp. 194–203.

33.

N.P.

Ricci ,

S.Z.

Guyer and

J.E.B.

Moss , Elephant Tracks: generating program traces with object death records[C], Proceedings of the 9th International Conference on Principles and Practice of Programming in Java, ACM2011, pp. 139–142.

34.

N.P.

Ricci ,

S.Z.

Guyer and

J.E.B.

Moss , Elephant tracks: portable production of complete and precise gc traces[J], ACM Sigplan Notices48(11) (2013), 109–118.

35.

J.B.

Sartor ,

Hirzel and

K.S.

McKinley , No bit left behind: the limits of heap data compression[C], Proceedings of the 7th international symposium on Memory management, ACM2008, pp. 111–120.

36.

SciMark 2.0 [Online]. Available: http://math.nist.gov/scimark2/

37.

Sewe ,

Yuan ,

Sinschek et al., Headroom-based pretenuring: dynamically pretenuring objects that live long enough[C], Proceedings of the 8th International Conference on the Principles and Practice of Programming in Java, ACM2010, pp. 29–38.

38.

Shi ,

Xie and

Yu , Profiling java objects without overhead in java heaps[C], Asian Symposium on Programming Languages and Systems, Springer International Publishing, 2014, pp. 408–427

39.

Silva and

Simmonds , BehaviorDroid: monitoring Android applications[C], Proceedings of the International Workshop on Mobile Software Engineering and Systems, ACM2016, 19–20.

40.

T.H.

Su ,

H.J.

Tsai ,

K.H.

Yang et al., Reconfigurable vertical profiling framework for the android runtime system[J], ACM Transactions on Embedded Computing Systems (TECS)13(2s) (2014), 59.

41.

Tang ,

Gao and

Qin , LeakSurvivor: Towards safely tolerating memory leaks for garbage-collected languages[C], USENIX 2008 Annual Technical Conference, USENIX Association, (2008), 307–320.

42.

Wu ,

Liu ,

Deng et al., Relda2: an effective static analysis tool for resource leak detection in Android apps[C], Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, ACM2016, pp. 762–767.

43.

Xu and

Rountev , Precise memory leak detection for java software using container profiling[C], 2008 ACM/IEEE 30th International Conference on Software Engineering, IEEE2008, 151–160.

44.

Xu and

Rountev , Detecting inefficiently-used containers to avoid bloat[C], ACM Sigplan Notices, ACM45(6) (2010), 160–173.

45.

Xu ,

Mitchell ,

Arnold et al., Software bloat analysis: finding, removing, and preventing performance problems in modern large-scale object-oriented applications[C], Proceedings of the FSE/SDP workshop on Future of software engineering research, ACM2010,pp.421–426.

46.

Xu ,

Mitchell ,

Arnold et al., Finding low-utility data structures[J], ACM Sigplan Notices45(6) (2010), 174–186.

47.

Xu ,

M.D.

Bond ,

Qin et al., LeakChaser: helping programmers narrow down causes of memory leaks[C], ACM SIGPLAN Notices, ACM46(6) (2011), 270–282.

48.

Xu , Finding reusable data structures[C], ACM SIGPLAN Notices, ACM47(10) (2012), 1017–1034.

49.

Xu , Resurrector: A tunable object lifetime profiling technique for optimizing real-world programs[C], ACM SIGPLAN Notices, ACM, 48(10) (2013), 111–130.

50.

Xu ,

Mitchell ,

Arnold et al., Scalable runtime bloat detection using abstract dynamic slicing[J], ACM Transactions on Software Engineering and Methodology (TOSEM)23(3) (2014), 23.

51.

Yan ,

Xu ,

Yang et al., LeakChecker: Practical static memory leak detection for managed languages[C], Proceedings of Annual IEEE/ACM International Symposium on Code Generation and Optimization, ACM, (2014), p. 87.

52.

Yang ,

Yan ,

Wu et al., Static control-flow analysis of user-driven callbacks in Android applications[C], Proceedings of the 37th International Conference on Software Engineering-Volume 1 IEEE Press, 2015, pp. 89–99.

53.

YourKit 2016. [Online]. Available: https://www.yourkit.com

54.

Yu ,

Shi and

Feng , LeakTracer: Tracing leaks along the way[C], Source Code Analysis and Manipulation (SCAM), 2015 IEEE 15th International Working Conference on IEEE2015, pp. 181–190.

55.

Zhang ,

Wu and

Rountev , Automated test generation for detection of leaks in Android applications[C], Proceedings of the 11th International Workshop on Automation of Software Test, ACM2016, 64–70.

56.

Zorn , Barrier methods for garbage collection[M]. Boulder: Department of Computer Science, University of Colorado, 1990.

A low-overhead and efficient Java object profiler on ART virtual machine

Abstract

Keywords

Get full access to this article

References