hdfs oiv分析调试篇

最新推荐文章于 2022-03-24 19:40:15 发布

原创最新推荐文章于 2022-03-24 19:40:15 发布 · 1k 阅读

0 ·

本内容遵循CC 4.0 BY-SA版权协议

收录于

HDFS

本文介绍了一个Java类FsimageOIV，用于通过OfflineImageViewerPB工具将fsimage文件转换为CSV格式。示例代码展示了如何使用该类及工具，通过指定输入fsimage文件路径和输出CSV文件路径来执行转换。此外，还提供了详细的日志信息，显示了从fsimage文件中加载字符串表、inode引用、目录和inode的过程。

开发板推荐：天空星STM32F407VET6开发板

超高性价比 STM32主控 | 超高主频 | 一板兼容百芯 | 比赛神器 | 沉金彩色丝印

点击查看

public class FsimageOIV {
	@Test
	public void oiv() throws Exception{
		String[] args = {"-p","Delimited", "-i", "/Users/didi/Work/test/fsimage_0000000000000029436",
				"-o","/Users/didi/Work/test/fsimage_0000000000000029436.csv"};
		
		OfflineImageViewerPB.main(args);
	}
}

[hadoop@hadoop1 current]$
[hadoop@hadoop1 current]$ hdfs oiv -p Delimited -delimiter "," -i fsimage_0000000000000029436 -o fsimage_0000000000000029436.csv
2020-03-09 12:15:28,169 DEBUG util.Shell: setsid exited with exit code 0
2020-03-09 12:15:28,228 INFO offlineImageViewer.PBImageTextWriter: Loading string table
2020-03-09 12:15:28,237 INFO offlineImageViewer.FSImageHandler: Loading 7 strings
2020-03-09 12:15:28,239 INFO offlineImageViewer.PBImageTextWriter: Loading inode references
2020-03-09 12:15:28,239 INFO offlineImageViewer.FSImageHandler: Loading inode references
2020-03-09 12:15:28,247 INFO offlineImageViewer.FSImageHandler: Loaded 0 inode references
2020-03-09 12:15:28,248 INFO offlineImageViewer.PBImageTextWriter: Loading directories
2020-03-09 12:15:28,251 INFO offlineImageViewer.PBImageTextWriter: Loading directories in INode section.
2020-03-09 12:15:28,278 DEBUG offlineImageViewer.PBImageTextWriter: Scanned 0 inodes.
2020-03-09 12:15:28,309 INFO offlineImageViewer.PBImageTextWriter: Found 440 directories in INode section.
2020-03-09 12:15:28,310 INFO offlineImageViewer.PBImageTextWriter: Finished loading directories in 61ms
2020-03-09 12:15:28,310 INFO offlineImageViewer.PBImageTextWriter: Loading INode directory section.
2020-03-09 12:15:28,318 INFO offlineImageViewer.PBImageTextWriter: Scanned 398 INode directories to build namespace.
2020-03-09 12:15:28,318 INFO offlineImageViewer.PBImageTextWriter: Finished loading INode directory section in 8ms
2020-03-09 12:15:28,337 INFO offlineImageViewer.PBImageTextWriter: Found 2104 INodes in the INode section
2020-03-09 12:15:28,359 DEBUG offlineImageViewer.PBImageTextWriter: Outputted 0 INodes.
2020-03-09 12:15:28,678 INFO offlineImageViewer.PBImageTextWriter: Outputted 2104 INodes.
2020-03-09 12:15:28,678 DEBUG offlineImageViewer.PBImageTextWriter: Time to output inodes: 360ms

在这里插入图片描述
有对应的visit方法。

遍历sessions，一共10个session

NS_INFO
STRING_TABLE
ERASURE_CODING
INODE
INODE_REFERENCE
SNAPSHOT
INODE_DIR
FILES_UNDERCONSTRUCTION
SECRET_MANAGER
CACHE_MANAGER

开发板推荐：天空星STM32F407VET6开发板

超高性价比 STM32主控 | 超高主频 | 一板兼容百芯 | 比赛神器 | 沉金彩色丝印

点击查看