A Comprehensive Approach to Mitigate Return-Oriented Programming Attacks: Combining Operating System Protection Mechanisms and Hardware-Assisted Techniques

This paper proposes a comprehensive approach to mitigate ROP (Return-Oriented Programming) attacks by combining internal operating system protection mechanisms and hardware-assisted techniques. Through extensive literature review, we identify the effectiveness of ASLR (Address Space Layout Randomiza...

Full description

Saved in:
Bibliographic Details
Published in:2023 IEEE 8th International Conference On Software Engineering and Computer Systems (ICSECS) pp. 453 - 458
Main Authors: Zhang, Xingnan, Huang, Jingjia, Feng, Yue
Format: Conference Proceeding
Language:English
Published: IEEE 25.08.2023
Subjects:
ASLR
Buffer overflows
CFI
code randomization
DEP
hardware-assisted CFI
Layout
LBR
Operating System
Operating systems
Process control
Programming
Returning-Oriented Programming attacks
ROP attacks
Software
Solids
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper proposes a comprehensive approach to mitigate ROP (Return-Oriented Programming) attacks by combining internal operating system protection mechanisms and hardware-assisted techniques. Through extensive literature review, we identify the effectiveness of ASLR (Address Space Layout Randomization) and LBR (Last Branch Record) in preventing ROP attacks. We present a process involving buffer overflow detection, hardware-assisted ROP attack detection, and the use of Turing detection technology to monitor control flow behavior. We envision a specialized tool that views and analyzes the last branch record, compares control flow with a baseline, and outputs differences in natural language. This tool offers a graphical interface, facilitating the prevention and detection of ROP attacks. The proposed approach and tool provide practical solutions for enhancing software security.
DOI:10.1109/ICSECS58457.2023.10256382