Home Database Mysql Tutorial 64位CentOS系统下安装配置伪分布式hadoop 2.5.2

64位CentOS系统下安装配置伪分布式hadoop 2.5.2

Jun 07, 2016 pm 03:09 PM
64 bit centos hadoop distributed Install system Configuration

安装完之后进行配置,首先所有的配置文件从上一版本的hadoop/conf换成了hadoop/etc/hadoop,在hadoop安装目录下,修改 etc/hadoop/core-site.xml,将其配置为: configuration property namehadoop.tmp.dir/name value/usr/hadoop/tmp/value descriptionA ba

安装完之后进行配置,首先所有的配置文件从上一版本的hadoop/conf换成了hadoop/etc/hadoop,在hadoop安装目录下,修改 etc/hadoop/core-site.xml,将其配置为:


 

      hadoop.tmp.dir

      /usr/hadoop/tmp

      A base for other temporary directories.

 

 

      fs.defaultFS

      hdfs://你的ip:9000

 

然后执行修改etc/hadoop/hdfs-site.xml进行第二项配置:

   

        dfs.namenode.name.dir

        /usr/hadoop/hdfs/name

   

   

        dfs.datanode.data.dir

        /usr/hadoop/hdfs/data

   

   

        dfs.replication

        1

   

请注意上述路径都需要自己手动用mkdir创建,具体位置也可以自己选择,其中dfs.replication的值建议配置为与分布式 cluster 中实际的 DataNode 主机数一致,在这里由于是伪分布式环境所以设置其为1。

接下来修改 etc/hadoop/mapred-site.xml配置其使用 Yarn 框架执行 map-reduce 处理程序,内容如下: 
  
   
  mapreduce.framework.name 
  Yarn 
 
 
 


最后修改 etc/hadoop/yarn-site.xml对yarn进行配置,其内容如下:


   

 

    Yarn.nodemanager.aux-services

    mapreduce.shuffle 

       

 

    The address of the applications manager interface in the RM.       

    Yarn.resourcemanager.address         

    你的ip:18040           

 

 

    The address of the scheduler interface.

    Yarn.resourcemanager.scheduler.address 

    你的ip:18030   

 

 

    The address of the RM web application.

    Yarn.resourcemanager.webapp.address 

    你的ip:18088   

 

 

    The address of the resource tracker interface.

    Yarn.resourcemanager.resource-tracker.address 

    你的ip:8025   

 

然后格式化:
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undress AI Tool

Undress AI Tool

Undress images for free

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

PHP Tutorial
1598
276
Quick PHP Installation Tutorial Quick PHP Installation Tutorial Jul 18, 2025 am 04:52 AM

ToinstallPHPquickly,useXAMPPonWindowsorHomebrewonmacOS.1.OnWindows,downloadandinstallXAMPP,selectcomponents,startApache,andplacefilesinhtdocs.2.Alternatively,manuallyinstallPHPfromphp.netandsetupaserverlikeApache.3.OnmacOS,installHomebrew,thenrun'bre

PHP 8 Installation Guide PHP 8 Installation Guide Jul 16, 2025 am 03:41 AM

The steps to install PHP8 on Ubuntu are: 1. Update the software package list; 2. Install PHP8 and basic components; 3. Check the version to confirm that the installation is successful; 4. Install additional modules as needed. Windows users can download and decompress the ZIP package, then modify the configuration file, enable extensions, and add the path to environment variables. macOS users recommend using Homebrew to install, and perform steps such as adding tap, installing PHP8, setting the default version and verifying the version. Although the installation methods are different under different systems, the process is clear, so you can choose the right method according to the purpose.

System requirements to install linux System requirements to install linux Jul 20, 2025 am 03:49 AM

Linuxcanrunonmodesthardwarewithspecificminimumrequirements.A1GHzprocessor(x86orx86_64)isneeded,withadual-coreCPUrecommended.RAMshouldbeatleast512MBforcommand-lineuseor2GBfordesktopenvironments.Diskspacerequiresaminimumof5–10GB,though25GBisbetterforad

How to format a new disk in CentOS How to format a new disk in CentOS Aug 03, 2025 am 08:19 AM

Identifythenewdiskusinglsblkorfdisk-ltolocatethecorrectdevicelike/dev/sdb.2.Optionallypartitionthediskwithfdisk/dev/sdb,createaprimarypartitionusingdefaultsettings,andwritechangeswithw,thenrunpartprobetoupdatethekernel.3.Createafilesystemusingmkfs-tx

What to do when the Windows installation is stuck What to do when the Windows installation is stuck Aug 06, 2025 am 03:45 AM

Wait1–2hoursifdiskactivitycontinues,asWindowsSetupmayappearfrozenduringfileexpansionorupdateinstallation.2.Recognizenormalslowphaseslike"Gettingdevicesready"orfirstboot.3.Forcerestartonlyafter2 hoursofnoactivitybyholdingthepowerbutton.4.Use

PHP Installation for Beginners PHP Installation for Beginners Jul 17, 2025 am 04:15 AM

Installing PHP is not complicated for novices. The key is to clarify the system environment and version requirements and follow the steps. First, you need to confirm the operating system (Windows, macOS or Linux) and choose a stable version such as PHP8.1 or 8.2; secondly, you can install it through manual installation, using integrated environments (such as XAMPP, WAMP) or package management tools (such as apt-get and brew). Then configure environment variables to ensure that the command line can recognize PHP instructions and run through the phpinfo() page test; finally pay attention to common problems, such as Apache port occupation, php.ini file path errors and extensions not enabled, etc., and check them one by one to complete the installation smoothly.

What to do after installing linux What to do after installing linux Jul 23, 2025 am 02:57 AM

AfterinstallingLinux,thefirststepsincludeupdatingyoursystem,installingessentialsoftware,settingupbackupandsecuritymeasures,andcustomizingtheinterfacetosuityourpreferences.1)Updateyoursystemusingtheappropriatecommandforyourdistro(e.g.,sudoaptupdate&am

How to configure MongoDB support for PHP environment Settings for PHP connection to Mongo database How to configure MongoDB support for PHP environment Settings for PHP connection to Mongo database Jul 23, 2025 pm 06:54 PM

To configure the PHP environment to support MongoDB, the core step is to install and enable the PHP driver of MongoDB to enable the PHP application to communicate with the MongoDB database. 1. Install MongoDBPHP driver, it is recommended to use PECL to install. If there is no PECL, you need to first install the PHP development package and related compilation tools; 2. Edit the php.ini file and add extension=mongodb.so (or .dll) to enable the extension; 3. Restart the web server or PHP-FPM service to make the configuration take effect; 4. Verify whether the extension is loaded successfully through phpinfo() or php-m. Frequently asked questions include missing PECL commands, compilation errors, php.ini

See all articles