ÔÚHDFSÖУ¬NameNodeÊÇϵͳµÄºËÐĽڵ㣬Ëü´æ´¢Á˸÷ÀàÔªÊý¾ÝµÄÐÅÏ¢£¬²¢¸ºÔð¹ÜÀíÎļþϵͳµÄÃüÃû¿Õ¼äºÍ¿Í»§¶Ë¶ÔÎļþµÄ·ÃÎÊ¡£µ«ÊÇ£¬ÔÚHadoop1.0°æ±¾ÖУ¬NameNodeÖ»ÓÐÒ»¸ö£¬Ò»µ©Õâ¸öNameNode·¢Éú¹ÊÕÏ£¬¾Í»áµ¼ÖÂÕû¸öHadoop¼¯Èº²»¿ÉÓã¬Ò²¾ÍÊÇ·¢ÉúÁ˵¥µã¹ÊÕÏÎÊÌâ¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2022-06-28 |ÀÖÓãµç¾º |´óÊý¾ÝÅàѵ,HDFS¸ß¿ÉÓÿò¼Ü
´óÊý¾Ý·ÖÎöÓÐÍêÉÆµÄ²Ù×÷²½Ö裬ÏÈ·ÖÎöʲô£¬ºó·ÖÎöʲô£¬¸÷¸ö·ÖÎöµãÖ®¼ä¶¼ÓÐÂß¼ÁªÏµ£¬Ìåϵ»¯µÄ·ÖÎöÐγɣ¬Ê¹¹¤×÷¸ü¼Ó¸ßЧ±ã½Ý£¬Êý¾Ý¸üÓÐ˵·þÁ¦¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2021-04-22 |ÀÖÓãµç¾º |´óÊý¾ÝÒµÎñ·ÖÎö²½Öè,Êý¾ÝµÄÊÕ¼¯,ÕûÀí,Õ¹Ïֺ͹¤×÷±¨¸æ
Hadoop·¢Ðа汾·ÖΪ¿ªÔ´ÉçÇø°æºÍÉÌÒµ°æ£¬ÉçÇø°æÊÇÖ¸ÓÉApacheÈí¼þ»ù½ð»áά»¤µÄ°æ±¾£¬Êǹٷ½Î¬»¤µÄ°æ±¾Ìåϵ¡£ÉÌÒµ°æHadoopÊÇÖ¸ÓɵÚÈý·½ÉÌÒµ¹«Ë¾ÔÚÉçÇø°æHadoop»ù´¡ÉϽøÐÐÁËһЩÐ޸ġ¢ÕûºÏÒÔ¼°¸÷¸ö·þÎñ×é¼þ¼æÈÝÐÔ²âÊÔ¶ø·¢Ðеİ汾¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2021-04-14 |ÀÖÓãµç¾º |´óÊý¾ÝHadoop,HDFS,MapReduce
Apache HiveÊÇHadoopÉϵÄSQLÒýÇæ£¬Ò²ÊÇ´óÊý¾ÝϵͳÖÐÖØÒªµÄÊý¾Ý²Ö¿â¹¤¾ß£¬Spark SQLÖ§³Ö·ÃÎÊHiveÊý¾Ý²Ö¿â£¬È»ºóÔÚSparkÒýÇæÖнøÐÐͳ¼Æ·ÖÎö¡£½ÓÏÂÀ´½éÉÜͨ¹ýSpark SQL²Ù×÷HiveÊý¾Ý²Ö¿âµÄ¾ßÌåʵÏÖ²½Öè¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2021-04-14 |ÀÖÓãµç¾º |HiveÊý¾Ý²Ö¿âµÄ²Ù×÷, Spark SQLʵÏÖHiveÊý¾Ý²Ö¿âµÄ²Ù×÷
DataFrameÌṩÁËÁ½ÖÖÓï·¨·ç¸ñ£¬¼´DSL·ç¸ñÓï·¨ºÍSQL·ç¸ñÓï·¨£¬¶þÕßÔÚ¹¦ÄÜÉϲ¢ÎÞÇø±ð£¬½ö½öÊǸù¾ÝÓû§Ï°¹ß£¬×Ô¶¨ÒåÑ¡Ôñ²Ù×÷·½Ê½¡£½ÓÏÂÀ´£¬ÎÒÃÇͨ¹ýÁ½ÖÖÓï·¨·ç¸ñ£¬·Ö±ð½²½âDataFrame²Ù×÷µÄ¾ßÌå·½·¨¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2021-04-14 |ÀÖÓãµç¾º |DataFrame²Ù×÷£¬DataFrameµÄ³£ÓòÙ×÷
Spark¿ÉÒÔͨ¹ý²¢Ðм¯ºÏ´´½¨RDD¡£¼´´ÓÒ»¸öÒѾ´æÔڵļ¯ºÏ¡¢Êý×éÉÏ£¬Í¨¹ýSparkContext¶ÔÏóµ÷ÓÃparallelize()·½·¨´´½¨RDD¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2021-03-23 |ÀÖÓãµç¾º |Spark·½·¨´´½¨RDD
ÔÚWindowsϵͳÏ¿ª·¢Scala´úÂ룬¿ÉÒÔʹÓñ¾µØ»·¾³²âÊÔ£¬ÏÂÔØÎļþºó¼ÆËã»úÎÞ·¨ÏñÈËÒ»ÑùÖ±¹ÛµÄ¸ÐÊÜ×ֶεÄʵ¼Êº¬Ò壬ͨ¹ý·´Éä»úÖÆ¿ÉÒÔÍÆ¶Ï°üº¬Ìض¨ÀàÐͶÔÏóµÄSchemaÐÅÏ¢£¬Òò´ËÎÒÃÇÐèÒªÏÈÍê³ÉSchemaµÄ¿ª·¢¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2021-03-23 |ÀÖÓãµç¾º |Schema£¬RDDת»¯Ö®SchemaµÄ¿ª·¢
´´½¨SparkSession¶ÔÏó¿ÉÒÔͨ¹ý¡°SparkSession.builder().getOrCreate()¡±·½·¨»ñÈ¡£¬µ«µ±ÎÒÃÇʹÓÃSpark-Shell±àд³ÌÐòʱ£¬Spark-Shell¿Í»§¶Ë»áĬÈÏÌṩÁËÒ»¸öÃûΪ¡°sc¡±µÄSparkContext¶ÔÏóºÍÒ»¸öÃûΪ¡°spark¡±µÄSparkSession¶ÔÏó£¬Òò´ËÎÒÃÇ¿ÉÒÔÖ±½ÓʹÓÃÕâÁ½¸ö¶ÔÏó ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2021-03-23 |ÀÖÓãµç¾º |´´½¨DataFrame,
±±¾©Ð£Çø