手机版
你好,游客 登录 注册
背景:
阅读新闻

Ubuntu 搭建Hadoop源码阅读环境

[日期:2013-11-09] 来源:Linux社区  作者:devtao [字体: ]

JDK,Eclipse的安装请参考:Ubuntu 安装 搭建 J2EE 开发环境 http://www.linuxidc.com/Linux/2013-11/92526.htm

Ant安装:

下载ant:http://ant.apache.org/bindownload.cgi

解压Ant:

tar -xvzf apache-ant-1.9.2-bin.tar.gz

移动重命名:

  mv apache-ant-1.9.2/ ~/opt/
  mv apache-ant-1.9.2/ ant

配置环境变量,添加ANT_HOME,和$ANT_HOME/bin:

sudo vim /etc/profile

  .......................
  export ANT_HOME=/opt/ant
  export PATH=$PATH:$ANT_HOME/bin
 .......................

source /etc/profile

测试是否生效:

 ant -version
Apache Ant(TM) version 1.9.2 compiled on July 8 2013

Hadoop Eclipse 插件安装:

Hadoop的eclipse插件需要自行安装编译,也很简单,用ant进行编译打包

cd /opt/hadoop-1.2.1/src/contrib/eclipse-plugin

参考这篇文章:http://www.linuxidc.com/Linux/2013-11/92528.htm

此处贴出build.xml全部和META-INFO改动的:

build.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?> 

<!-- 
Licensed to the Apache Software Foundation (ASF) under one or more 
contributor license agreements.  See the NOTICE file distributed with 
this work for additional information regarding copyright ownership. 
The ASF licenses this file to You under the Apache License, Version 2.0 
(the "License"); you may not use this file except in compliance with 
the License.  You may obtain a copy of the License at 

http://www.apache.org/licenses/LICENSE-2.0 

Unless required by applicable law or agreed to in writing, software 
distributed under the License is distributed on an "AS IS" BASIS, 
   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 
   See the License for the specific language governing permissions and 
   limitations under the License. 
   --> 

   <!-- build.xml --> 
   <project default="jar" name="eclipse-plugin"> 

   <import file="../build-contrib.xml"/> 


   <property name="eclipse.home" location="/opt/eclipse"/> 
   <property name="version" value="1.2.1"/> 

   <path id="eclipse-sdk-jars"> 
   <fileset dir="${eclipse.home}/plugins/"> 
   <include name="org.eclipse.ui*.jar"/> 
   <include name="org.eclipse.jdt*.jar"/> 
   <include name="org.eclipse.core*.jar"/> 
   <include name="org.eclipse.equinox*.jar"/> 
   <include name="org.eclipse.debug*.jar"/> 
   <include name="org.eclipse.osgi*.jar"/> 
   <include name="org.eclipse.swt*.jar"/> 
   <include name="org.eclipse.jface*.jar"/> 

   <include name="org.eclipse.team.cvs.ssh2*.jar"/> 
   <include name="com.jcraft.jsch*.jar"/> 
   </fileset> 
   </path> 

   <!-- Override classpath to include Eclipse SDK jars --> 
   <path id="classpath"> 
   <pathelement location="${build.classes}"/> 
   <pathelement location="${hadoop.root}/build/classes"/> 
   <fileset dir="${hadoop.root}"> 
   <include name="**/*.jar" /> 
   </fileset> 
   <path refid="eclipse-sdk-jars"/> 
   </path> 

   <!-- Skip building if eclipse.home is unset. --> 
   <target name="check-contrib" unless="eclipse.home"> 
   <property name="skip.contrib" value="yes"/> 
   <echo message="eclipse.home unset: skipping eclipse plugin"/> 
   </target> 

   <target name="compile" depends="init, ivy-retrieve-common" unless="skip.contrib"> 
   <echo message="contrib: ${name}"/> 
   <javac 
   encoding="${build.encoding}" 
   srcdir="${src.dir}" 
   includes="**/*.java" 
   destdir="${build.classes}" 
   debug="${javac.debug}" 
   deprecation="${javac.deprecation}" 
   includeantruntime="on"> 
   <classpath refid="classpath"/> 
   </javac> 
   </target> 

   <!-- Override jar target to specify manifest --> 
   <target name="jar" depends="compile" unless="skip.contrib"> 
   <mkdir dir="${build.dir}/lib"/> 
   <!--  <copy file="${hadoop.root}/build/hadoop-core-${version}.jar" tofile="${build.dir}/lib/hadoop-core.jar" verbose="true"/> --> 
   <!--  <copy file="${hadoop.root}/build/ivy/lib/Hadoop/common/commons-cli-${commons-cli.version}.jar"  todir="${build.dir}/lib" verbose="true"/>--> 
   <copy file="${hadoop.root}/hadoop-core-${version}.jar" tofile="${build.dir}/lib/hadoop-core.jar" verbose="true"/> 
   <copy file="${hadoop.root}/lib/commons-cli-${commons-cli.version}.jar"  tofile="${build.dir}/lib/commons-cli.jar" verbose="true"/> 
   <copy file="${hadoop.root}/lib/commons-configuration-1.6.jar"  tofile="${build.dir}/lib/commons-configuration.jar" verbose="true"/> 
   <copy file="${hadoop.root}/lib/commons-httpclient-3.0.1.jar"  tofile="${build.dir}/lib/commons-httpclient.jar" verbose="true"/> 
   <copy file="${hadoop.root}/lib/commons-lang-2.4.jar"  tofile="${build.dir}/lib/commons-lang.jar" verbose="true"/> 
   <copy file="${hadoop.root}/lib/jackson-core-asl-1.8.8.jar"  tofile="${build.dir}/lib/jackson-core-asl.jar" verbose="true"/> 
   <copy file="${hadoop.root}/lib/jackson-mapper-asl-1.8.8.jar"  tofile="${build.dir}/lib/jackson-mapper-asl.jar" verbose="true"/> 


   <jar 
   jarfile="${build.dir}/hadoop-${name}-${version}.jar" 
   manifest="${root}/META-INF/MANIFEST.MF"> 
   <fileset dir="${build.dir}" includes="classes/ lib/"/> 
   <fileset dir="${root}" includes="resources/ plugin.xml"/> 
   </jar> 
   </target> 

   </project> 

更多详情见请继续阅读下一页的精彩内容http://www.linuxidc.com/Linux/2013-11/92527p2.htm

相关阅读

Ubuntu 13.04上搭建Hadoop环境  http://www.linuxidc.com/Linux/2013-06/86106.htm

Ubuntu上搭建Hadoop环境(单机模式+伪分布模式) http://www.linuxidc.com/Linux/2013-01/77681.htm

Ubuntu下Hadoop环境的配置 http://www.linuxidc.com/Linux/2012-11/74539.htm

单机版搭建Hadoop环境图文教程详解 http://www.linuxidc.com/Linux/2012-02/53927.htm

搭建Hadoop环境(在Winodws环境下用虚拟机虚拟两个Ubuntu系统进行搭建)  http://www.linuxidc.com/Linux/2011-12/48894.htm

linux
本文评论   查看全部评论 (0)
表情: 表情 姓名: 字数

       

评论声明
  • 尊重网上道德,遵守中华人民共和国的各项有关法律法规
  • 承担一切因您的行为而直接或间接导致的民事或刑事法律责任
  • 本站管理人员有权保留或删除其管辖留言中的任意内容
  • 本站有权在网站内转载或引用您的评论
  • 参与本评论即表明您已经阅读并接受上述条款