Friday, July 11, 2014

Programming Languages for Big Data, Part 2

I mentioned the recent study on the relative speeds of programming languages to Tommy Jones, a specialist in natural language processing and fellow member of the Data Community DC, and he, being more industrious than I, dove into the code used by the authors of the paper in question. In their R code, he found gems such as a triple-nested "for" loop inside a "while" loop (instead of the much faster "apply" functions), which made the comparisons pretty useless, at least in the case of R. See Tommy's blog, Biased Estimates, for more details.

Nonetheless, it's a pretty interesting question, and I'd love to see someone who's proficient in all of the languages involved try this test again, using better code. I'm still intrigued by the very high speed of MATLAB/Octave—something that leads Andrew Ng to recommend those languages over R for prototyping—though Tommy pointed out to me that, since R is closer to being a full-featured language, it's more flexible than the former languages.
Posted by at
Labels:

62 comments:

  1. raju vJanuary 11, 2018 at 3:13 AM

    This comment has been removed by the author.

    ReplyDelete
  2. Raj SharmaJune 14, 2019 at 6:02 AM

    Good Post. I like your blog. Thanks for Sharing
    Data Science Training in Noida

    ReplyDelete
  3. AnonymousJune 19, 2019 at 11:50 PM

    Curated by Matthew Pearson, Behavioral Economist at Airbnb. As a user researcher on Airbnb’s design team with a background in behavioral economics, Matthew brings methods and insights from economics and psychology to bear on the user experience, particularly as it relates to social interaction, cooperation, and trust.

    As a quantitative user researcher, I often collaborate with designers and other user researchers who are more accustomed to qualitative research, as well as data scientists in uae and others oriented toward quantitative work.

    I’ve also often been inspired by questions that the methods I was trained in are not well-equipped to answer, especially when it comes to understanding users’ motivations. As a result, I’ve developed an appreciation for the particular strengths of quantitative and qualitative research methods, and a better sense of which method is appropriate for a given context.

    This selection of articles represents, in my opinion, some of the best examples of both types of research and the pitfalls of asking your users a question that only your big data companies in dubai can answer, or vice-versa.

    ReplyDelete
  4. shanjamesJuly 9, 2019 at 11:17 PM

    This comment has been removed by the author.

    ReplyDelete
  5. harikaJuly 10, 2019 at 11:59 PM

    Good Post. I like your blog. Thanks for Sharing.................!
    Data Science Training in Bangalore

    ReplyDelete
  6. datasciencecourseJuly 13, 2019 at 2:09 AM

    Thanks for sharing this blog its very informative and useful for use.
    data science certification course training

    ReplyDelete
  7. Sara ShaikhJuly 28, 2019 at 11:52 PM

    It was very beautifully explaing thank you

    ReplyDelete
  8. jayapriyaSeptember 2, 2019 at 4:32 AM

    I prefer to study this kind of material. Nicely written information in this post, the quality of content is fine and the conclusion is lovely. Things are very open and intensely clear explanation of issues

    Hadoop Online Training

    ReplyDelete
  9. meenatiSeptember 12, 2019 at 5:49 AM

    Its very informative blog and useful article thank you for sharing with us , keep posting learn Data Science online Training in Hyderabad

    ReplyDelete
  10. meenatiOctober 11, 2019 at 6:23 AM

    Thanks for sharing valuable information. Your blogs were helpful to Azure learners. I request to update the blog through step-by-step.
    Data Science online Course

    ReplyDelete
  11. nareshitOctober 19, 2019 at 3:29 AM

    Thank you for sharing the article. The data that you provided in the blog is informative and effective.

    Best data science Online Training Institute

    ReplyDelete
  12. AmitDecember 2, 2019 at 1:06 AM

    Thanks for posting this info., its is very helpful for all of us.keep update with your blogs.


    Ecommerce Website Design Company in Bangalore
    SEO Company in Bangalore
    ERP Software Companies in Bangalore
    CRM Software in Bangalore

    ReplyDelete
  13. TechdatasolutionsblogDecember 14, 2019 at 11:34 AM

    Very Good Information...


    Data science Course in Mumbai



    Thank You Very Much For Sharing These Nice Tips..


    ReplyDelete
  14. harithaDecember 30, 2019 at 1:18 AM

    https://newdatascientist.blogspot.com/2014/07/programming-languages-for-big-data-part.html?showComment=1577449508281#c811107483844348668

    ReplyDelete
  15. harithaJanuary 2, 2020 at 3:26 AM

    Thank you for sharing the article. The data that you provided in the blog is informative and effective.
    Nodejs online training

    ReplyDelete
  16. shanjamesJanuary 24, 2020 at 11:12 PM

    Nice Blog | Thank you for sharing Such a wonderful information. The data that you provided in the blog is informative and effective.
    Data Science Training in Hyderabad

    ReplyDelete
  17. nareshitJanuary 28, 2020 at 2:53 AM

    Thank you for sharing the article. The data that you provided in the blog is informative and effective.

    Best Data Science Online Training Institute

    ReplyDelete
  18. Socio Maven MediaJanuary 28, 2020 at 10:29 PM

    I am really impressed with your blog article, such great & useful knowledge you mentioned here. Your post is very informative. I have read all your posts and all are very informative. Thanks for sharing and keep it up like this.
    best digital marketing agency

    ReplyDelete
  19. MinalJanuary 30, 2020 at 1:02 AM

    Interesting, such an Excellent description! Thanks for sharing such an informative blog for Programming Languages for Big Data !!
    Bright Education Center

    ReplyDelete
  20. manishaFebruary 6, 2020 at 1:47 AM

    Very useful blog for beginners, Thank you very much for sharing.
    Data Science Training in Delhi
    Data Science Training institute in Delhi

    ReplyDelete
  21. High Technologies SolutionsFebruary 12, 2020 at 12:56 AM

    Python web development is quite in demand and a very good option for Python developers. In over the span of 25 years, Python has managed to reach a level that is high above others making it the fastest growing language.

    Best Python Training Center in Delhi, India

    Advanced Python Training Institute in Delhi
    Advanced Python Training Institute in Noida

    ReplyDelete
  22. Bhanu sriMarch 9, 2020 at 12:43 AM

    This comment has been removed by the author.

    ReplyDelete
  23. Abu samadApril 17, 2020 at 4:50 AM

    This is such a great post and was thinking much the same myself. Another great update.
    Online Data Science Training in Pune, Mumbai, Delhi NCR

    ReplyDelete
  24. Naresh I TechnologiesJune 22, 2020 at 3:11 AM

    Thank you so much for sharing this amazing blog with us. Anyone who are searching for more, free training's like Data science, Python, Java, Asp.Net, Nodejs and more programming languages please contact Nareshit.
    NodeJS Online Training
    Data Science Online Training

    ReplyDelete
  25. priyasriJune 28, 2020 at 8:08 PM

    I have to search sites with relevant information on given topic and provide them to teacher our opinion and the article.

    360digitmg data scientist course online

    ReplyDelete
  26. priyasriJuly 2, 2020 at 2:39 AM

    I don’t think many of websites provide this type of information.
    360digitmg business analytics courses

    ReplyDelete
  27. Hina BajwaJuly 3, 2020 at 7:24 AM

    ebizz.co.uk
    ebizz.co.uk
    ebizz.co.uk
    ebizz.co.uk
    ebizz.co.uk

    ReplyDelete
  28. tejaswiniJuly 4, 2020 at 12:33 AM

    Just saying thanks will not just be sufficient, for the fantasti c lucidity in your writing. I will instantly grab your rss feed to stay informed of any updates.data science bootcamp malaysia

    ReplyDelete
  29. AnonymousJuly 6, 2020 at 4:09 AM

    Look at our Latest listed properties and check out the facilities on them, We have already sold more than 5,000 Homes and we are still going at very good pace. We would love you to look into these properties and we hope that you will find something match-able to your needs.
    "Properties In Hyderabad"

    ReplyDelete
  30. Power Mind TechnologiesJuly 7, 2020 at 3:06 AM

    Thanks for Sharing a Lovely Post for us and Please Keep Updating & Increase Our Knowledge & If anyone Want to Grow your Career in Python Language So you Can Contact Here-9354210902/ 9310806006 Or Visit Website-https://www.powermindtech.com/

    Here is the best Training Center for Data Science

    python training institute in gurgaon
    python training Center in gurgaon


    ReplyDelete
  31. aarthiJuly 8, 2020 at 12:42 AM

    good blog.keep going...
    Java training in Chennai | Certification | Online Course Training | Java training in Bangalore | Certification | Online Course Training | Java training in Hyderabad | Certification | Online Course Training | Java training in Coimbatore | Certification | Online Course Training | Java training in Online | Certification | Online Course Training

    ReplyDelete
  32. SEO TandaleJuly 25, 2020 at 7:43 AM

    you are doing good work.
    Best Regards from Cook With Yamini Gowtham

    ReplyDelete
  33. UnknownAugust 7, 2020 at 9:00 PM

    Very knowledgable Blog. Thanks for giving such a good Knowledge on Big Data.Keep Sharing.

    ReplyDelete
  34. AnonymousSeptember 10, 2020 at 2:37 AM

    Great post! I am actually getting ready to across this information, It’s very helpful for this blog. Also great with all of the valuable information you have Keep up the good work you are doing well.
    paloalto secure

    ReplyDelete
  35. Python Training ExpertSeptember 28, 2020 at 4:03 AM

    I have bookmarked your Website since this site contains important data in it. You rock for guardianship incredible stuff. I am a lot of grateful of this site.

    Python Training Institute in Delhi
    Python Training Course in Delhi
    Python Training Center in Delhi

    ReplyDelete
  36. manishaSeptember 28, 2020 at 4:17 AM

    Thanks for sharing this blog. Its written very nicely.
    Data Science Training in Noida
    Data Science Training institute in Noida
    Data Science Course in Noida

    ReplyDelete
  37. Data Science Corporate TrainingOctober 2, 2020 at 4:31 AM

    I have been reading for the past two days about your blogs and topics, still on fetching! Wondering about your words on each line was massively effective. Techno-based information has been fetched in each of your topics. Sure it will enhance and fill the queries of the public needs. Feeling so glad about your article. Thanks…!

    ReplyDelete
  38. Data Science Corporate TrainingOctober 9, 2020 at 3:26 AM

    Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading

    ReplyDelete
  39. High Technologies SolutionsOctober 24, 2020 at 2:19 AM

    I have read your post very carefully and get some interesting tips and tricks on Data Science. Thanks for sharing this post with us.

    ReplyDelete
  40. Python Training ExpertDecember 24, 2020 at 2:39 AM

    Python is one of the most popular, general purpose, interpreted and high-level programming language. SOL Technologies Solutions delivers best python training institute in Delhi.

    Python training institute in delhi
    Python training Course in delhi

    ReplyDelete
  41. Praveen KumarFebruary 3, 2021 at 11:41 PM

    Data Science Training in Noida

    ReplyDelete
  42. 360digitmgFebruary 26, 2021 at 8:30 AM

    This is a wonderful article, Given so much info in it, These type of articles keeps the users interest in the website, and keep on sharing more ... good luck.
    learn artificial intelligence ecil

    ReplyDelete
  43. data scientist courseApril 15, 2021 at 9:24 PM

    This is a brilliant article, Given such a great amount of data in it, These kind of articles keeps the clients enthusiasm for the site, and continue sharing more ... good karma.
    data scientist training in hyderabad

    ReplyDelete
  44. 360DigiTMG-PuneMay 14, 2021 at 4:53 AM

    thanks for share
    data science certification

    ReplyDelete
  45. reeshuJune 12, 2021 at 7:06 PM

    Thank you for sharing this information .
    online training

    ReplyDelete
  46. AnonymousSeptember 23, 2021 at 2:52 AM

    Best internet service provider in Hyderabad

    ReplyDelete
  47. harithaSeptember 28, 2021 at 3:32 AM

    NEOLOG ONLINE SERVICES PVT LTD. Broadband is the leading Best internet service provider in Hyderabad. We are offering high-speed unlimited internet services.

    internet service

    ReplyDelete
  48. harithaSeptember 28, 2021 at 3:35 AM

    Best internet service provider in Hyderabad
    NEOLOG ONLINE SERVICES PVT LTD. Broadband is the leading Best internet service provider in Hyderabad. We are offering high-speed unlimited internet services.

    ReplyDelete
  49. UnknownOctober 14, 2021 at 1:44 AM

    Good information you shared. keep posting.
    artificial intelligence courses in chennai

    ReplyDelete
  50. harithaNovember 12, 2021 at 12:08 AM

    I recently came across your blog and have been reading along. I thought I would leave my first comment. I don't know what to say except that I have enjoyed reading. Nice blog. I will keep visiting this blog very often.

    With decades of clinical data behind our ingredients, our high-performance formulas are made to make a difference in your skin. All while looking great on your bathroom shelf.

    skincare brand

    ReplyDelete
  51. harithaNovember 12, 2021 at 12:09 AM

    I recently came across your blog and have been reading along. I thought I would leave my first comment. I don't know what to say except that I have enjoyed reading. Nice blog. I will keep visiting this blog very often.

    With decades of clinical data behind our ingredients, our high-performance formulas are made to make a difference in your skin. All while looking great on your bathroom shelf.

    best skincare products

    ReplyDelete
  52. Prasad BrollyacademyAugust 23, 2025 at 4:50 AM

    This made my day, thanks!


    Snowflake Training In Hyderabad

    ReplyDelete
  53. brollyaiSeptember 1, 2025 at 6:18 AM

    Great overview of programming language options for big data! The comparison of Scala’s functional strengths, Python’s ease of use (especially with pandas and PySpark), and Java’s robust ecosystem really helps clarify which tool to choose based on workload complexity and team familiarity. Thanks for laying it out so clearly!

    ReplyDelete
  54. azuretrainingSeptember 4, 2025 at 2:34 AM

    This comment has been removed by the author.

    ReplyDelete
  55. Guidewire MastersOctober 9, 2025 at 12:50 AM

    Brolly Academy has been a reputable institution offering academic assistance and skill enhancement programs for more than 8 years. Our dedicated team of highly experienced educators and professionals is driven by a strong passion for empowering students and has a demonstrated history of enabling students to reach their aspirations.At Brolly Academy, we believe that every student has the potential to achieve great things. That’s why we’ve dedicated ourselves to providing the highest quality education and support to help students unlock their full potential and thrive in their academic and personal lives.
    Digital Marketing Course In Hyderabad

    ReplyDelete
  56. Digital SaiDecember 5, 2025 at 2:05 AM

    I really enjoyed reading this post because the way you structured everything is brilliant. It’s both engaging and educational. Keep up the good work and continue inspiring others!
    Digital Marketing Freelancer

    ReplyDelete
  57. ZetSIMJanuary 9, 2026 at 3:45 AM

    Great overview of programming languages for big data very informative!
    I especially liked how you compared their strengths and use cases.
    Thanks for sharing this helpful resource!
    uk e sim providers

    ReplyDelete
  58. travel-esimJanuary 22, 2026 at 3:59 AM

    This article gives a clear overview of programming languages used in big data. It’s helpful for anyone deciding which language to learn first.Student Sim

    ReplyDelete
  59. travel-esimJanuary 22, 2026 at 4:00 AM

    Thanks for sharing this! The comparison of different languages makes it easier to understand their strengths in big data applications.USA unlimited calls and data

    ReplyDelete
  60. travel-esimJanuary 22, 2026 at 4:01 AM

    I found this post informative and practical. It highlights useful options depending on the specific data work you want to do.canada esim prepaid

    ReplyDelete
  61. travel-esimJanuary 22, 2026 at 4:02 AM

    Great breakdown of languages like Python, R, and Java. This helped me see which ones are best suited for various big data tasks.global eSIM partner

    ReplyDelete
  62. travel-esimJanuary 22, 2026 at 4:03 AM

    This was a useful read. The explanations make it easier to choose a programming language based on your goals in data science or analytics.eSIM business partnership

    ReplyDelete

Subscribe to: Post Comments (Atom)