openioc_scan - IOC scanner for memory forensics
10 likes5,448 views
The document discusses the openioc_scan tool, a memory forensic IOC scanner designed for malware analysis and compromise detection. It provides insights on the implementation, usage, and practical applications of openioc_scan, particularly in remote malware triage scenarios. Various examples of specific and generic IOCs are provided, along with performance considerations and references for further information.
![IOC (Indicator Of Compromise)
• A piece of information that can be used to search for
or identify potentially compromised systems [1]
5
• specific indicators
• e.g., URL, file hash
Forensic
Analysis
• generic (function-based)
indicators
• e.g., used API, binary code
Malware
Analysis
• define & improve
• scan on live system, disk
image, memory image
IOC](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-5-320.jpg)
![openioc_scan
• Memory forensic IOC scanner implemented as a
plugin of Volatility Framework [2]
• scans IOCs written in OpenIOC 1.1 format
• case sensitiveness, regular expression (“matches” condition),
parameters [3]
• supports only Windows (Vista or later)
• 3 python packages required
• lxml [4]
• ioc_writer [5]
• colorma [6]
6](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-6-320.jpg)
![The 1st IOC example
• Generating IOC for openioc_scan
• PyIOCe [7] made by Sean Gillespie
• The latest “terms” and “parameters” of volatility should be
imported [8][9]
• The following IOC means
• malicious svchost process NOT created from services
process
7](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-7-320.jpg)
![Supported 35 IOC Terms
• Check the blog entry for more information [8]
9
Term Category Term Examples
ProcessItem name, command line, parent name, DLL path, process/DLL
DKOM detection, code injection detection, imported/dynamic
generated API table, string, handle name, network connection,
IAT/EAT/inline hooked API name, enabled privilege name
RegistryItem metadata of executables cached by OS (ShimCache)
ServiceItem service name/description/command line
DriverItem name, imported/dynamic generated API table, string, hooked
IRP function table, callback function type, timer function
detection
HookItem hooked SSDT entry
FileItem filename/size/path based on carved MFT entry](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-9-320.jpg)
![Keep It Simple and Short #2
• e.g., process hollowing [10] detection
• Process hollowing technique hides malicious codes
into legitimate processes
1. create a new process with suspended state
2. free the process code and replace with malware
3. change the process context and resume it
• Merit
• Malware runs as the process
• The file path seems to be legitimate
• Malware takes privileges of the process (e.g., Firewall exception)
13
hollowed process
path from PEB](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-13-320.jpg)
![Keep It Simple and Short #2 (Cont.)
• e.g., process hollowing [10] detection
• Detection
• Freeing the process code changes VAD (Virtual Address
descriptor) characteristics [11]
14
Stuxnet
Path from FileObject
in VAD is null](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-14-320.jpg)
![What’s Equation Group?
• Threat actor introduced by Kaspersky in Feb. 2015
[12]
• used malware sets including EquationLaser, EquationDrug,
DoubleFantasy, TripleFantasy, Fanny, GrayFish
• HDD firmware reprogramming module
(nls_933w.dll) is loaded on EquationDrug and
GrayFish
• It generates hidden data area in HDD
• but still exists in RAM for providing API into the area!
20](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-20-320.jpg)
![nls_933w.dll Behavior [13]
• nls_933w.dll creates win32m.sys then communicate
with it using DeviceIoControl API
• 6 IoControlCodes used
• The code “0x870021D0” is used for read/write requests of ATA
device registers
• A kernel timer function handles the requests
• The data to write is embedded in the dll
• A combination of 6-byte data structure
21
“IDENTIFY_DEVICE”
command
read/write of ATA
device registers](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-21-320.jpg)
![onigiri.py - Remote Malware Triage
Automation [14]
• openioc_scan + F-Response [15]
= remote malware triage!
• F-Response provides read-only access to the full physical
disk(s) of any networked computer
• plus the physical memory (RAM) of most Microsoft Windows systems
• We can automate RAM acquisition from remote machine and
IOC scan using F-Response COM API
24
Examiner
Target Machine1. deploy F-Response agent
2. acquire RAM
3. identify the system profile
from SOFTWARE registry
4. execute openioc_scan](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-24-320.jpg)
![Usage (Cont.)
• Some preparations needed (3rd party tools, settings,..)
• [64bit python path] onigiri.py [actions] [options]
[output] [edition] [arguments for edition]
• actions
• -r: RAM acquisition
• -f: file acquisition by file categories (later)
• -s: IOC scan with RAM and SOFTWARE registry acquisition
• options
• IOC folder path, tool paths, admin credentials,..
• edition
• emc or cc
26](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-26-320.jpg)
![Notes
• onigiri supports not only a RAM acquisition but
also an acquisition including files with
unallocated (deleted) status
• sysreg,userreg,mft,prefetch,evtx,amcache,journal
• F-Response Flexdisk API used
• RAM acquisition may fail on Win 8.1 x64
• F-Response bug (not fixed)
• Use an alternate acquisition option using DumpIt 2.x
(paid version) [16]
• But DumpIt also may cause BSOD when using remote
acquisition option (not fixed)
• If any other errors, check “Trouble Shooting” in
README on GitHub
28](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-28-320.jpg)
![Reference
• [1] Sharing Indicators of Compromise: An Overview of Standards and Formats
• https://www.rsaconference.com/writable/presentations/file_upload/dsp-w25a.pdf
• [2] volatilityfoundation/volatility
• https://github.com/volatilityfoundation/volatility
• [3] mandiant/OpenIOC_1.1
• https://github.com/mandiant/OpenIOC_1.1
• [4] lxml 3.2.1 : Python Package Index
• https://pypi.python.org/pypi/lxml/3.2.1
• [5] mandiant/ioc_writer
• https://github.com/mandiant/ioc_writer
• [6] colorama 0.3.3 : Python Package Index
• https://pypi.python.org/pypi/colorama
• [7] yahoo/PyIOCe
• https://github.com/yahoo/PyIOCe
• [8] Fast Malware Triage Using Openioc_scan Volatility Plugin
• http://takahiroharuyama.github.io/blog/2014/08/15/fast-malware-triage-using-openioc-
scan-volatility-plugin/
31](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-31-320.jpg)
![Reference (Cont.)
• [9] OpenIOC Parameters Used by Openioc_scan
• http://takahiroharuyama.github.io/blog/2014/10/24/openioc-parameters-used-by-
openioc-scan/
• [10] Analyzing Malware Hollow Processes
• https://www.trustwave.com/Resources/SpiderLabs-Blog/Analyzing-Malware-Hollow-
Processes/
• [11] “The Art of Memory Forensics” p.261
• http://as.wiley.com/WileyCDA/WileyTitle/productCd-1118825098.html
• [12] “Equation group: questions and answers”
• https://securelist.com/files/2015/02/Equation_group_questions_and_answers.pdf
• [13] Internet Infrastructure Review (IIR) Vol.27
• http://www.iij.ad.jp/en/company/development/iir/027.html
• [14] Remote Malware Triage Automation
• http://takahiroharuyama.github.io/blog/2015/07/03/remote-malware-triage-
automation/
• [15] F-Response
• https://www.f-response.com/
• [16] MoonSols Windows Memory Toolkit
• http://www.moonsols.com/windows-memory-toolkit/
32](https://image.slidesharecdn.com/secure2015haruyama20150903-151015082328-lva1-app6891/85/openioc_scan-IOC-scanner-for-memory-forensics-32-320.jpg)
openioc_scan - IOC scanner for memory forensics
- 1. openioc_scan Takahiro Haruyama (@cci_forensics) Internet Initiative Japan Inc. SECURE 2015
- 2. Who am I? • Forensic Investigator & Malware Analyst at Internet Initiative Japan Inc. • IIR: Internet Infrastructure Review • http://www.iij.ad.jp/en/company/development/iir/index.html • Presentations and Hands-on classes • Black Hat Briefings USA/Europe/Asia, SANS DFIR Summit, DFRWS EU, CEIC, FIRST TC, etc... • Keywords • anti forensics, memory forensics, IOC, targeted attack, PlugX • Blog • http://takahiroharuyama.github.io/ • plugins/scripts for Volatility Framework, IDA Pro, Immunity Debugger and EnCase 2
- 3. Agenda • Introduction • Tips about Memory Forensic IOCs • openioc_scan vs. Equation Group • Remote Malware Triage • Wrap-up 3
- 5. IOC (Indicator Of Compromise) • A piece of information that can be used to search for or identify potentially compromised systems [1] 5 • specific indicators • e.g., URL, file hash Forensic Analysis • generic (function-based) indicators • e.g., used API, binary code Malware Analysis • define & improve • scan on live system, disk image, memory image IOC
- 6. openioc_scan • Memory forensic IOC scanner implemented as a plugin of Volatility Framework [2] • scans IOCs written in OpenIOC 1.1 format • case sensitiveness, regular expression (“matches” condition), parameters [3] • supports only Windows (Vista or later) • 3 python packages required • lxml [4] • ioc_writer [5] • colorma [6] 6
- 7. The 1st IOC example • Generating IOC for openioc_scan • PyIOCe [7] made by Sean Gillespie • The latest “terms” and “parameters” of volatility should be imported [8][9] • The following IOC means • malicious svchost process NOT created from services process 7
- 8. The 1st IOC example (Cont.) • openioc_scan options • -i IOC_DIR, --ioc_dir=IOC_DIR • location of IOCs directory (required) • -s, --show • display mode (not scan) • -t, --test • test mode (useful for debugging IOC) 8 PlugX detected
- 9. Supported 35 IOC Terms • Check the blog entry for more information [8] 9 Term Category Term Examples ProcessItem name, command line, parent name, DLL path, process/DLL DKOM detection, code injection detection, imported/dynamic generated API table, string, handle name, network connection, IAT/EAT/inline hooked API name, enabled privilege name RegistryItem metadata of executables cached by OS (ShimCache) ServiceItem service name/description/command line DriverItem name, imported/dynamic generated API table, string, hooked IRP function table, callback function type, timer function detection HookItem hooked SSDT entry FileItem filename/size/path based on carved MFT entry
- 10. Tips about Memory Forensic IOCs 10
- 11. Specific IOC vs. Generic IOC • 2 IOC types in memory forensics • Specific IOC • e.g., unique URL, string, binary data/code sequence • Generic IOC • e.g., suspicious process tree, code injection sign, API function name used/hooked by malware • Generic ones recommended in less urgent situations 11 specific IOC generic IOC advantage easy to define (low false positive rate) detect unknown malware with similar traits weakness detect the malware only hard to define (high false positive rate)
- 12. Keep It Simple and Short • Good IOCs should be simple • e.g., generic code injection detection • Injected codes • often hook APIs (e.g., HttpSendRequest*, PR_Write) • cannot be resolved from module linked lists (e.g., InLoadOrderModuleList) 12 Andromeda Tinba
- 13. Keep It Simple and Short #2 • e.g., process hollowing [10] detection • Process hollowing technique hides malicious codes into legitimate processes 1. create a new process with suspended state 2. free the process code and replace with malware 3. change the process context and resume it • Merit • Malware runs as the process • The file path seems to be legitimate • Malware takes privileges of the process (e.g., Firewall exception) 13 hollowed process path from PEB
- 14. Keep It Simple and Short #2 (Cont.) • e.g., process hollowing [10] detection • Detection • Freeing the process code changes VAD (Virtual Address descriptor) characteristics [11] 14 Stuxnet Path from FileObject in VAD is null
- 15. Focus on Functions • IOCs based on malware functions become generic automatically • e.g., detecting malware hiding data in NTFS $EA • NTFS $EA (Extended Attribute) is provided for backward compatibility with OS/2 applications • Two APIs: Zw(Nt)QueryEaFile and Zw(Nt)SetEaFile • ZeroAccess (user mode) and Regin (kernel mode) use the APIs • openioc_scan checks not only IAT but also dynamically- generated API tables 15 ZeroAccess
- 16. Use Parameter • OpenIOC 1.1 supports “Parameter” (metadata for each IOC term) • Detail Parameter: display not only matched substring but also total one • e.g., unusual path detection • Malware often runs from abnormal locations 16 parameter: detail=on Dridex
- 17. Use Parameter #2 • By adding Score Parameter, openioc_scan additionally evaluates IOCs based on the total of its integer values (>=100) • e.g., information-stealing malware detection • Hooked HttpSendRequest APIs and unknown hooking module name (due to code injection) 17
- 18. Consider Performance • Scanning all IOCs at one time is STUPID • prioritize fast IOC terms over slow ones • fast: e.g., process name/path, network connection • slow: e.g., string, binary sequence, used/hooked API name • Avoid combination of multiple IOC term categories • Especially, ProcessItem and DriverItem are heavily iterated • Define them separately, or limit the scope by adding –p (process) / -m (driver) options • Information extracted by openioc_scan is cached • The 2nd time scan for the same term gets the result in less time • searched in cached SQLite database • Binary sequences, however, are NOT cached • instead, searched in individual process/driver memory dumps 18
- 20. What’s Equation Group? • Threat actor introduced by Kaspersky in Feb. 2015 [12] • used malware sets including EquationLaser, EquationDrug, DoubleFantasy, TripleFantasy, Fanny, GrayFish • HDD firmware reprogramming module (nls_933w.dll) is loaded on EquationDrug and GrayFish • It generates hidden data area in HDD • but still exists in RAM for providing API into the area! 20
- 21. nls_933w.dll Behavior [13] • nls_933w.dll creates win32m.sys then communicate with it using DeviceIoControl API • 6 IoControlCodes used • The code “0x870021D0” is used for read/write requests of ATA device registers • A kernel timer function handles the requests • The data to write is embedded in the dll • A combination of 6-byte data structure 21 “IDENTIFY_DEVICE” command read/write of ATA device registers
- 22. nls_933w.dll IOCs • Specific IOCs • dll: IoControlCodes and 6-byte data structure • driver: IoControlCodes and a binary code sequence parsing the structure • Generic IOC • driver: APIs for ATA device IO and kernel timer 22
- 24. onigiri.py - Remote Malware Triage Automation [14] • openioc_scan + F-Response [15] = remote malware triage! • F-Response provides read-only access to the full physical disk(s) of any networked computer • plus the physical memory (RAM) of most Microsoft Windows systems • We can automate RAM acquisition from remote machine and IOC scan using F-Response COM API 24 Examiner Target Machine1. deploy F-Response agent 2. acquire RAM 3. identify the system profile from SOFTWARE registry 4. execute openioc_scan
- 25. Usage • It depends on the F-Response edition • Enterprise provides COM APIs for Enterprise Management Console (EMC) • We can fully automate including the remote agent deployment • Consultant and Consultant+Covert provide APIs for Consultant Connector (CC) • We must deploy the agent manually • Consultant: export it to USB thumb drive then run on the target PC • Consultant+Covert: use Consultant+Covert console (“Direct Connect” menu) 25
- 26. Usage (Cont.) • Some preparations needed (3rd party tools, settings,..) • [64bit python path] onigiri.py [actions] [options] [output] [edition] [arguments for edition] • actions • -r: RAM acquisition • -f: file acquisition by file categories (later) • -s: IOC scan with RAM and SOFTWARE registry acquisition • options • IOC folder path, tool paths, admin credentials,.. • edition • emc or cc 26
- 27. 27 DEMO (EMC) “C:¥Python27¥python.exe” onigiri.py -s -i C:¥ioc_mine C:¥tmp¥onigiri-out emc 10.xxx.xxx.xxx
- 28. Notes • onigiri supports not only a RAM acquisition but also an acquisition including files with unallocated (deleted) status • sysreg,userreg,mft,prefetch,evtx,amcache,journal • F-Response Flexdisk API used • RAM acquisition may fail on Win 8.1 x64 • F-Response bug (not fixed) • Use an alternate acquisition option using DumpIt 2.x (paid version) [16] • But DumpIt also may cause BSOD when using remote acquisition option (not fixed) • If any other errors, check “Trouble Shooting” in README on GitHub 28
- 29. Wrap-up 29
- 30. Wrap-up • Are you still detecting malware based on only hash values? • openioc_scan enables to detect faster and deeper than disk-based traditional IOCs • Tools are available on GitHub • openioc_scan and generic/specific IOC examples • https://github.com/TakahiroHaruyama/openioc_scan • onigiri (remote malware triage script) • https://github.com/TakahiroHaruyama/onigiri 30
- 31. Reference • [1] Sharing Indicators of Compromise: An Overview of Standards and Formats • https://www.rsaconference.com/writable/presentations/file_upload/dsp-w25a.pdf • [2] volatilityfoundation/volatility • https://github.com/volatilityfoundation/volatility • [3] mandiant/OpenIOC_1.1 • https://github.com/mandiant/OpenIOC_1.1 • [4] lxml 3.2.1 : Python Package Index • https://pypi.python.org/pypi/lxml/3.2.1 • [5] mandiant/ioc_writer • https://github.com/mandiant/ioc_writer • [6] colorama 0.3.3 : Python Package Index • https://pypi.python.org/pypi/colorama • [7] yahoo/PyIOCe • https://github.com/yahoo/PyIOCe • [8] Fast Malware Triage Using Openioc_scan Volatility Plugin • http://takahiroharuyama.github.io/blog/2014/08/15/fast-malware-triage-using-openioc- scan-volatility-plugin/ 31
- 32. Reference (Cont.) • [9] OpenIOC Parameters Used by Openioc_scan • http://takahiroharuyama.github.io/blog/2014/10/24/openioc-parameters-used-by- openioc-scan/ • [10] Analyzing Malware Hollow Processes • https://www.trustwave.com/Resources/SpiderLabs-Blog/Analyzing-Malware-Hollow- Processes/ • [11] “The Art of Memory Forensics” p.261 • http://as.wiley.com/WileyCDA/WileyTitle/productCd-1118825098.html • [12] “Equation group: questions and answers” • https://securelist.com/files/2015/02/Equation_group_questions_and_answers.pdf • [13] Internet Infrastructure Review (IIR) Vol.27 • http://www.iij.ad.jp/en/company/development/iir/027.html • [14] Remote Malware Triage Automation • http://takahiroharuyama.github.io/blog/2015/07/03/remote-malware-triage- automation/ • [15] F-Response • https://www.f-response.com/ • [16] MoonSols Windows Memory Toolkit • http://www.moonsols.com/windows-memory-toolkit/ 32