ITPub博客
首页 博客 专栏 学院 社区 IT新媒体评选
发博

首页 > 应用开发 > Java > Akka之WordCount with SBT

Akka之WordCount with SBT

原创 Java 作者：541732025 时间：2016-05-04 16:05:39 0 删除 编辑
build.sbt：

点击(此处)折叠或打开

  1. name := "HelloAkkaWithSBT"

  3. version := "1.0"

  5. scalaVersion := "2.9.2"

  7. resolvers += "Typesafe Repository" at "http://repo.typesafe.com/typesafe/releases"

  9. libraryDependencies += "com.typesafe.akka" % "akka-actor" % "2.0.3"

MasterActor：

点击(此处)折叠或打开

  1. class MasterActor extends Actor{
  2.   val aggregateActor : ActorRef = context.actorOf(Props[AggregateActor], name = "aggregate")
  3.   val reduceActor : ActorRef = context.actorOf(Props(new ReduceActor(aggregateActor)), name = "reduce")
  4.   val mapActor : ActorRef = context.actorOf(Props(new MapActor(reduceActor)), "map")

  6.   override protected def receive: Receive = {
  7.     case message : String =>
  8.       mapActor ! message
  9.     case message : Result =>
  10.       aggregateActor ! message
  11.     case _ =>

  13.   }
  14. }

MapActor：

点击(此处)折叠或打开

  1. class MapActor(reduceActor: ActorRef) extends Actor{
  2.   val STOP_WORDS_LIST = List("a", "is")

  4.   override protected def receive: Receive = {
  5.     case message : String =>
  6.       reduceActor ! map(message)
  7.     case _ =>
  8.   }

  10.   def map(line : String): MapData = {
  11.     val dataList = new util.ArrayList[Word]
  12.     val parser : StringTokenizer = new StringTokenizer(line)
  13.     val defaultCount : Integer = 1;
  14.     while(parser.hasMoreTokens){
  15.       val word : String = parser.nextToken().toLowerCase()

  17.       if(!STOP_WORDS_LIST.contains(word)){
  18.         dataList.add(new Word(word, defaultCount))
  19.       }
  20.     }

  22.     return new MapData(dataList)
  23.   }
  24. }

ReduceActor：

点击(此处)折叠或打开

  1. class ReduceActor(aggregateActor : ActorRef) extends Actor{

  3.   override protected def receive: Receive = {
  4.     case message : MapData =>
  5.       aggregateActor ! reduce(message.dataList)
  6.     case _ =>
  7.   }

  9.   def reduce(dataList: util.ArrayList[Word]): ReduceData = {
  10.     val reduceMap = new util.HashMap[String, Integer]
  11.     if(!dataList.isEmpty()){
  12.       for(wc : Word <- dataList){
  13.         val word = wc.word
  14.         if(reduceMap.containsKey(word)){
  15.           reduceMap.put(word, reduceMap.get(word) + 1)
  16.         }else{
  17.           reduceMap.put(word, 1)
  18.         }
  19.       }
  20.     }

  22.     return new ReduceData(reduceMap)
  23.   }
  24. }

AggregateActor：

点击(此处)折叠或打开

  1. class AggregateActor extends Actor{
  2.   val finalReduceMap = new util.HashMap[String, Integer]

  4.   override protected def receive: Receive = {
  5.     case message : ReduceData =>
  6.       aggregate(message.reduceMap)
  7.     case message : Result =>
  8.       println(finalReduceMap.toString)
  9.   }

  11.   def aggregate(reduceMap: util.HashMap[String, Integer]): Unit = {
  12.     var count : Integer = 0
  13.     for(key : String <- reduceMap.keySet()){
  14.       if(finalReduceMap.containsKey(key)){
  15.         count = reduceMap.get(key)
  16.         count += finalReduceMap.get(key)
  17.         finalReduceMap.put(key, count)
  18.       }else{
  19.         finalReduceMap.put(key, reduceMap.get(key))
  20.       }
  21.     }
  22.   }
  23. }

入口：

点击(此处)折叠或打开

  1. object MapReduceApplication {
  2.    def main (args: Array[String]){
  3.     val _system = ActorSystem("HelloAkka")
  4.      val master = _system.actorOf(Props[MasterActor], name = "master")

  6.      master ! "Hi! My name is Rocky. I'm so so so happy to be here."
  7.      master ! "Today, I'm going to read a news article for you."
  8.      master ! "I hope I hope you'll like it."

  10.      Thread.sleep(500)
  11.      master ! new Result

  13.      Thread.sleep(500);
  14.      _system.shutdown()
  15.   }
  16. }

SBT运行结果：

来自 “ ITPUB博客 ” ，链接：https://blog.itpub.net/28912557/viewspace-2093556/ ，如需转载，请注明出处，否则将追究法律责任。

0
0
上一篇： MasterActor详解
下一篇： 没有了~
请登录后发表评论 登录
全部评论
541732025

注册时间：2013-05-23

  • 博文量
    127
  • 访问量
    515720

最新文章

支持我们 作者招募 用户协议 FAQ Contact Us

北京盛拓优讯信息技术有限公司. 版权所有  京ICP备16024965号-8 北京市公安局海淀分局网监中心备案编号：11010802021510 niuxiaotong@pcpop.com 17352615567 未成年人举报专区

广播电视节目制作经营许可证(京) 字第1234号 中国互联网协会会员

违法和不良信息举报电话:18101376593