Hadoop NodeManager

YARN - NodeManager

Container management under node nodes

1. Register with ResourceManager at startup and send a heartbeat message on a timely day, waiting for ResourceManager's instructions
2. Monitor The operation of Container, maintain the life cycle of Container, and monitor the use of Container's resources
3. Start or stop Container, manage the dependency packages at the time the task runs (copy the programs you need and their dependent packages, profiles, etc. locally before starting Container, as required by The ApplicationMaster)

The internal structure

• NodeStatusUpdater: Start registering with ResourceManager to report on the node's available resources, the port of communication, and subsequent state maintenance

• ContainerManager: Receive RPC requests (start, stop), resource localization (download the resources required by the app locally and share them as needed)

  PUBLIC: /filecache

  PRIVATE: /usercache//filecache

  APPLICATION: /usercache / / appcache / /(will be deleted after the program is completed)

• ContainersLauncher: Load or terminate Container

• ContainerMonitor: Monitor Container's operations and resource usage
• ContainerExecutor: Interact with the underlying operating system to load the programs you want to run