♊️ GemiNews 🗞️ (dev)

Demo 1: Embeddings + Recommendation Demo 2: Bella RAGa Demo 3: NewRetriever Demo 4: Assistant function calling

🗞️Ruby 3.3.0-rc1 Released

🗿Semantically Similar Articles (by :title_embedding)

Ruby 3.3.0-rc1 Released

2023-12-11 - (from Ruby (EN RSS))

We are pleased to announce the release of Ruby 3.3.0-rc1. Ruby 3.3 adds a new parser named Prism, uses Lrama as a parser generator, adds a new pure-Ruby JIT compiler named RJIT, and many performance improvements especially YJIT. After the release of RC1, we will avoid introducing ABI incompatibilities wherever possible. If we need to do, we’ll announce it in the release note. Prism Introduced the Prism parser as a default gem Prism is a portable, error tolerant, and maintainable recursive descent parser for the Ruby language Prism is production ready and actively maintained, you can use it in place of Ripper There is extensive documentation on how to use Prism Prism is both a C library that will be used internally by CRuby and a Ruby gem that can be used by any tooling which needs to parse Ruby code Notable methods in the Prism API are: Prism.parse(source) which returns the AST as part of a ParseResult Prism.dump(source) which returns the serialized AST as a String Prism.parse_comments(source) which returns the comments You can make pull requests or issues directly on the Prism repository if you are interested in contributing Use Lrama instead of Bison Replace Bison with Lrama LALR parser generator Feature #19637 If you have interest, please see The future vision of Ruby Parser Lrama internal parser is replaced with LR parser generated by Racc for maintainability Parameterizing Rules (?, *, +) are supported, it will be used in Ruby parse.y RJIT Introduced a pure-Ruby JIT compiler RJIT and replaced MJIT. RJIT supports only x86-64 architecture on Unix platforms. Unlike MJIT, it doesn’t require a C compiler at runtime. RJIT exists only for experimental purposes. You should keep using YJIT in production. If you are interested in developing JIT for Ruby, please check out k0kubun’s presentation on Day 3 of RubyKaigi. YJIT Major performance improvements over 3.2 Support for splat and rest arguments has been improved. Registers are allocated for stack operations of the virtual machine. More calls with optional arguments are compiled. Exception handlers are also compiled. Instance variables no longer exit to the interpreter with megamorphic object shapes. Unsupported call types no longer exit to the interpreter. Integer#!=, String#!=, Kernel#block_given?, Kernel#is_a?, Kernel#instance_of?, Module#=== are specially optimized. Now more than 3x faster than the interpreter on optcarrot! Significantly improved memory usage over 3.2 Metadata for compiled code uses a lot less memory. Generate more compact code on ARM64 Compilation speed is now slightly faster than 3.2. Add RubyVM::YJIT.enable that can enable YJIT at run-time You can start YJIT without modifying command-line arguments or environment variables. This can also be used to enable YJIT only once your application is done booting. --yjit-disable can be used if you want to use other YJIT options while disabling YJIT at boot. Code GC is now disabled by default, and --yjit-exec-mem-size is treated as a hard limit where compilation of new code stops. Better copy-on-write behavior on servers using unicorn and forking No sudden drops in performance due to code GC. You can still enable code GC if desired with --yjit-code-gc ratio_in_yjit stat produced by --yjit-stats is now available in release builds, a special stats or dev build is no longer required to access most stats. Exit tracing option now supports sampling --trace-exits-sample-rate=N --yjit-perf is added to facilitate profiling with Linux perf. More thorough testing and multiple bug fixes M:N thread scheduler M:N thread scheduler was introduced. [Feature #19842] M Ruby threads are managed by N native threads (OS threads) so the thread creation and management cost are reduced. It can break C-extension compatibility so that M:N thread scheduler is disabled on the main Ractor by default. RUBY_MN_THREADS=1 environment variable enables M:N threads on the main Ractor. M:N threads are enabled on non-main Ractors. RUBY_MAX_CPU=n environment variable sets maximum number of N (maximum number of native threads). The default value is 8. Since only one Ruby thread per Ractor can run at the same time, the number of native threads will be used, which is the smaller of the number specified in RUBY_MAX_CPU and the number of running Ractors. So that single Ractor applications (most of applications) will use 1 native thread. To support blocking operations, more than N native threads can be used. Other Notable New Features Language Performance improvements defined?(@ivar) is optimized with Object Shapes. Name resolution such as Socket.getaddrinfo can now be interrupted (in environments where pthreads are available). Feature #19965 For this purpose, a pthread is now created whenever calling getaddrinfo or getnameinfo. This incurs some overhead in name resolution (about 2.5x in our experiments). We do not expect the name resolution overhead to be a problem for most applications, but if you observe such, or if you see unexpected affects that you believe are due to this change, please report them. Several performance improvements to the Garbage Collector Young objects referenced by old objects are no longer immediately promoted to the old generation. This significantly reduces the frequency of major GC collections. [Feature #19678] A new REMEMBERED_WB_UNPROTECTED_OBJECTS_LIMIT_RATIO tuning variable was introduced to control the number of unprotected objects cause a major GC collection to trigger. The default is set to 0.01 (1%). This significantly reduces the frequency of major GC collection. [Feature #19571] Write Barriers were implemented for many core types that were missing them, notably Time, Enumerator, MatchData, Method, File::Stat, BigDecimal and several others. This significantly reduces minor GC collection time and major GC collection frequency. Most core classes are now using Variable Width Allocation, notably Hash, Time, Thread::Backtrace, Thread::Backtrace::Location, File::Stat, Method. This makes these classes faster to allocate and free, use less memory and reduce heap fragmentation. Support for weak references has been added to the garbage collector. [Feature #19783] Other notable changes since 3.2 IRB IRB has received several enhancements, including but not limited to: Advanced irb:rdbg integration that provides an equivalent debugging experience to pry-byebug (doc). Pager support for ls, show_source and show_cmds commands. More accurate and helpful information provided by the ls and show_source commands. Experimental autocompletion using type analysis (doc). It is now possible to change the font color and font style in the completion dialog by a newly introduced class Reline::Face (doc) In addition, IRB has also undergone extensive refactoring and received dozens of bug fixes to facilitate easier future enhancements. Compatibility issues Note: Excluding feature bug fixes. it calls without arguments in a block with no ordinary parameters are deprecated. it will be a reference to the first block parameter in Ruby 3.4. Feature #18980 Removed constants The following deprecated constants are removed. Removed methods The following deprecated methods are removed. Removed environment variables The following deprecated environment variables are removed. Environment variable RUBY_GC_HEAP_INIT_SLOTS has been deprecated and is a no-op. Please use environment variables RUBY_GC_HEAP_{0,1,2,3,4}_INIT_SLOTS instead. Feature #19785 Stdlib compatibility issues ext/readline is retired We have reline that is pure Ruby implementation compatible with ext/readline API. We rely on reline in the future. If you need to use ext/readline, you can install ext/readline via rubygems.org with gem install readline-ext. We no longer need to install libraries like libreadline or libedit. C API updates Updated C APIs The following APIs are updated. Removed C APIs The following deprecated APIs are removed. Standard library updates RubyGems and Bundler warn if users require gem that is scheduled to become the bundled gems in the future version of Ruby. Targeted libraries are: abbrev base64 bigdecimal csv drb getoptlong mutex_m nkf observer racc resolv-replace rinda syslog The following default gem is added. prism 0.15.1 The following default gems are updated. RubyGems 3.5.0.dev base64 0.2.0 benchmark 0.3.0 bigdecimal 3.1.5 bundler 2.5.0.dev cgi 0.4.0 csv 3.2.8 date 3.3.4 delegate 0.3.1 drb 2.2.0 english 0.8.0 erb 4.0.3 etc 1.4.3.dev.1 fcntl 1.1.0 fiddle 1.1.2 fileutils 1.7.2 find 0.2.0 getoptlong 0.2.1 io-console 0.6.1.dev irb 1.8.3 logger 1.6.0 mutex_m 0.2.0 net-http 0.4.0 net-protocol 0.2.2 nkf 0.1.3 observer 0.1.2 open-uri 0.4.0 open3 0.2.0 openssl 3.2.0 optparse 0.4.0 ostruct 0.6.0 pathname 0.3.0 pp 0.5.0 prettyprint 0.2.0 pstore 0.1.3 psych 5.1.1.1 rdoc 6.6.0 reline 0.3.9 rinda 0.2.0 securerandom 0.3.0 shellwords 0.2.0 singleton 0.2.0 stringio 3.0.9 strscan 3.0.7 syntax_suggest 1.1.0 tempfile 0.2.0 time 0.3.0 timeout 0.4.1 tmpdir 0.2.0 tsort 0.2.0 un 0.3.0 uri 0.13.0 weakref 0.1.3 win32ole 1.8.10 yaml 0.3.0 zlib 3.1.0 The following bundled gem is promoted from default gems. racc 1.7.3 The following bundled gems are updated. minitest 5.20.0 rake 13.1.0 test-unit 3.6.1 rexml 3.2.6 rss 0.3.0 net-imap 0.4.4 net-smtp 0.4.0 rbs 3.2.2 typeprof 0.21.8 debug 1.8.0 See GitHub releases like Logger or changelog for details of the default gems or bundled gems. See NEWS or commit logs for more details. With those changes, 5414 files changed, 306141 insertions(+), 183575 deletions(-) since Ruby 3.2.0! Download https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.tar.gz SIZE: 21783575 SHA1: c75a860e06f27b7f69b874757417277c21d1d3f4 SHA256: c4ff82395a90ef76c7f906b7687026e0ab96b094dcf3a532d9ab97784a073222 SHA512: 265fb2ffe55af47d8349edffcebe749cc170291227cef55529fe4e67363e4e84b88daa34ffb5364a99c8a0e32110266a34c9a11d62f3bd6f6d47fa76eca641f4 https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.tar.xz SIZE: 16163884 SHA1: 26503f9bdc7d0a05aaa9836f54d3aa9e74a9ead9 SHA256: 051815637f1fa75a1edf2c54b66d5d5b69563daad777da8dc39543b7754b5290 SHA512: 82f4acfaad1dc47db27ee3eb952481a95b3474a98059e9e9f5ceb035b690d1faabe99f2ec52371c4089ed1615eb10c395f029088418fec4d26399b65b4f259b9 https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.zip SIZE: 26735443 SHA1: 35583453a7734216b08829ef0ec9ea1bc0d4ae7f SHA256: 56dd82e1dd714f2889ca975ae7befbe005675de08839c2cc4a484de2ae65201c SHA512: 7fbe414c230aedc9f364512bcbc213038f8f6e4268929a559d2527e2f3e32a140b394e37098ab7e59161236eca8b89cc9e52d73a3be8d7bd44faa91681483f5d What is Ruby Ruby was first developed by Matz (Yukihiro Matsumoto) in 1993, and is now developed as Open Source. It runs on multiple platforms and is used all over the world especially for web development. Posted by naruse on 11 Dec 2023

empty

[Technology] 🌎 https://www.ruby-lang.org/en/news/2023/12/11/ruby-3-3-0-rc1-released/ [🧠] [v2] article_embedding_description: {:llm_project_id=>"Unavailable", :llm_dimensions=>nil, :article_size=>19188, :llm_embeddings_model_name=>"textembedding-gecko"}
[🧠] [v1/3] title_embedding_description: {:ricc_notes=>"[embed-v3] Fixed on 9oct24. Only seems incompatible at first glance with embed v1.", :llm_project_id=>"unavailable possibly not using Vertex", :llm_dimensions=>nil, :article_size=>19188, :poly_field=>"title", :llm_embeddings_model_name=>"textembedding-gecko"}
[🧠] [v1/3] summary_embedding_description: {:ricc_notes=>"[embed-v3] Fixed on 9oct24. Only seems incompatible at first glance with embed v1.", :llm_project_id=>"unavailable possibly not using Vertex", :llm_dimensions=>nil, :article_size=>19188, :poly_field=>"summary", :llm_embeddings_model_name=>"textembedding-gecko"}
[🧠] As per bug https://github.com/palladius/gemini-news-crawler/issues/4 we can state this article belongs to titile/summary version: v3 (very few articles updated on 9oct24)

🗿article.to_s

------------------------------
Title: Ruby 3.3.0-rc1 Released
Summary: We are pleased to announce the release of Ruby 3.3.0-rc1. Ruby 3.3 adds a new parser named Prism, uses Lrama as a parser generator, adds a new pure-Ruby JIT compiler named RJIT, and many performance improvements especially YJIT.

After the release of RC1, we will avoid introducing ABI incompatibilities wherever possible. If we need to do, we’ll announce it in the release note.

Prism


  Introduced the Prism parser as a default gem
    
      Prism is a portable, error tolerant, and maintainable recursive descent parser for the Ruby language
    
  
  Prism is production ready and actively maintained, you can use it in place of Ripper
    
      There is extensive documentation on how to use Prism
      Prism is both a C library that will be used internally by CRuby and a Ruby gem that can be used by any tooling which needs to parse Ruby code
      Notable methods in the Prism API are:
        
          Prism.parse(source) which returns the AST as part of a ParseResult
          Prism.dump(source) which returns the serialized AST as a String
          Prism.parse_comments(source) which returns the comments
        
      
    
  
  You can make pull requests or issues directly on the Prism repository if you are interested in contributing


Use Lrama instead of Bison


  Replace Bison with Lrama LALR parser generator Feature #19637
    
      If you have interest, please see The future vision of Ruby Parser
      Lrama internal parser is replaced with LR parser generated by Racc for maintainability
      Parameterizing Rules (?, *, +) are supported, it will be used in Ruby parse.y
    
  


RJIT


  Introduced a pure-Ruby JIT compiler RJIT and replaced MJIT.
    
      RJIT supports only x86-64 architecture on Unix platforms.
      Unlike MJIT, it doesn’t require a C compiler at runtime.
    
  
  RJIT exists only for experimental purposes.
    
      You should keep using YJIT in production.
    
  
  If you are interested in developing JIT for Ruby, please check out k0kubun’s presentation on Day 3 of RubyKaigi.


YJIT


  Major performance improvements over 3.2
    
      Support for splat and rest arguments has been improved.
      Registers are allocated for stack operations of the virtual machine.
      More calls with optional arguments are compiled.
      Exception handlers are also compiled.
      Instance variables no longer exit to the interpreter
with megamorphic object shapes.
      Unsupported call types no longer exit to the interpreter.
      Integer#!=, String#!=, Kernel#block_given?, Kernel#is_a?,
Kernel#instance_of?, Module#=== are specially optimized.
      Now more than 3x faster than the interpreter on optcarrot!
    
  
  Significantly improved memory usage over 3.2
    
      Metadata for compiled code uses a lot less memory.
      Generate more compact code on ARM64
    
  
  Compilation speed is now slightly faster than 3.2.
  Add RubyVM::YJIT.enable that can enable YJIT at run-time
    
      You can start YJIT without modifying command-line arguments or environment variables.
      This can also be used to enable YJIT only once your application is
done booting. --yjit-disable can be used if you want to use other
YJIT options while disabling YJIT at boot.
    
  
  Code GC is now disabled by default, and --yjit-exec-mem-size is treated
as a hard limit where compilation of new code stops.
    
      Better copy-on-write behavior on servers using unicorn and forking
      No sudden drops in performance due to code GC.
      You can still enable code GC if desired with --yjit-code-gc
    
  
  ratio_in_yjit stat produced by --yjit-stats is now available in release builds,
a special stats or dev build is no longer required to access most stats.
  Exit tracing option now supports sampling
    
      --trace-exits-sample-rate=N
    
  
  --yjit-perf is added to facilitate profiling with Linux perf.
  More thorough testing and multiple bug fixes


M:N thread scheduler


  M:N thread scheduler was introduced. [Feature #19842]
    
      M Ruby threads are managed by N native threads (OS threads) so the thread creation and management cost are reduced.
      It can break C-extension compatibility so that M:N thread scheduler is disabled on the main Ractor by default.
        
          RUBY_MN_THREADS=1 environment variable enables M:N threads on the main Ractor.
          M:N threads are enabled on non-main Ractors.
        
      
      RUBY_MAX_CPU=n environment variable sets maximum number of N (maximum number of native threads). The default value is 8.
        
          Since only one Ruby thread per Ractor can run at the same time, the number of native threads will be used, which is the smaller of the number specified in RUBY_MAX_CPU and the number of running Ractors. So that single Ractor applications (most of applications) will use 1 native thread.
          To support blocking operations, more than N native threads can be used.
        
      
    
  


Other Notable New Features

Language

Performance improvements


  defined?(@ivar) is optimized with Object Shapes.
  Name resolution such as Socket.getaddrinfo can now be interrupted (in environments where pthreads are available). Feature #19965
    
      For this purpose, a pthread is now created whenever calling getaddrinfo or getnameinfo. This incurs some overhead in name resolution (about 2.5x in our experiments). We do not expect the name resolution overhead to be a problem for most applications, but if you observe such, or if you see unexpected affects that you believe are due to this change, please report them.
    
  
  Several performance improvements to the Garbage Collector
    
      Young objects referenced by old objects are no longer immediately
  promoted to the old generation. This significantly reduces the frequency of
  major GC collections. [Feature #19678]
      A new REMEMBERED_WB_UNPROTECTED_OBJECTS_LIMIT_RATIO tuning variable was
  introduced to control the number of unprotected objects cause a major GC
  collection to trigger. The default is set to 0.01 (1%). This significantly
  reduces the frequency of major GC collection. [Feature #19571]
      Write Barriers were implemented for many core types that were missing them,
  notably Time, Enumerator, MatchData, Method, File::Stat, BigDecimal
  and several others. This significantly reduces minor GC collection time and major
  GC collection frequency.
      Most core classes are now using Variable Width Allocation, notably Hash, Time,
  Thread::Backtrace, Thread::Backtrace::Location, File::Stat, Method.
  This makes these classes faster to allocate and free, use less memory and reduce
  heap fragmentation.
      Support for weak references has been added to the garbage collector. [Feature #19783]
    
  


Other notable changes since 3.2

IRB

IRB has received several enhancements, including but not limited to:


  Advanced irb:rdbg integration that provides an equivalent debugging experience to pry-byebug (doc).
  Pager support for ls, show_source and show_cmds commands.
  More accurate and helpful information provided by the ls and show_source commands.
  Experimental autocompletion using type analysis (doc).
  It is now possible to change the font color and font style in the completion dialog by a newly introduced class Reline::Face (doc)


In addition, IRB has also undergone extensive refactoring and received dozens of bug fixes to facilitate easier future enhancements.

Compatibility issues

Note: Excluding feature bug fixes.


  it calls without arguments in a block with no ordinary parameters are
deprecated. it will be a reference to the first block parameter in Ruby 3.4.
Feature #18980


Removed constants

The following deprecated constants are removed.

Removed methods

The following deprecated methods are removed.

Removed environment variables

The following deprecated environment variables are removed.


  Environment variable RUBY_GC_HEAP_INIT_SLOTS has been deprecated and is a no-op. Please use environment variables RUBY_GC_HEAP_{0,1,2,3,4}_INIT_SLOTS instead. Feature #19785


Stdlib compatibility issues

ext/readline is retired


  We have reline that is pure Ruby implementation compatible with ext/readline API. We rely on reline in the future. If you need to use ext/readline, you can install ext/readline via rubygems.org with gem install readline-ext.
  We no longer need to install libraries like libreadline or libedit.


C API updates

Updated C APIs

The following APIs are updated.

Removed C APIs

The following deprecated APIs are removed.

Standard library updates

RubyGems and Bundler warn if users require gem that is scheduled to become the bundled gems in the future version of Ruby.

Targeted libraries are:

  abbrev
  base64
  bigdecimal
  csv
  drb
  getoptlong
  mutex_m
  nkf
  observer
  racc
  resolv-replace
  rinda
  syslog


The following default gem is added.


  prism 0.15.1


The following default gems are updated.


  RubyGems 3.5.0.dev
  base64 0.2.0
  benchmark 0.3.0
  bigdecimal 3.1.5
  bundler 2.5.0.dev
  cgi 0.4.0
  csv 3.2.8
  date 3.3.4
  delegate 0.3.1
  drb 2.2.0
  english 0.8.0
  erb 4.0.3
  etc 1.4.3.dev.1
  fcntl 1.1.0
  fiddle 1.1.2
  fileutils 1.7.2
  find 0.2.0
  getoptlong 0.2.1
  io-console 0.6.1.dev
  irb 1.8.3
  logger 1.6.0
  mutex_m 0.2.0
  net-http 0.4.0
  net-protocol 0.2.2
  nkf 0.1.3
  observer 0.1.2
  open-uri 0.4.0
  open3 0.2.0
  openssl 3.2.0
  optparse 0.4.0
  ostruct 0.6.0
  pathname 0.3.0
  pp 0.5.0
  prettyprint 0.2.0
  pstore 0.1.3
  psych 5.1.1.1
  rdoc 6.6.0
  reline 0.3.9
  rinda 0.2.0
  securerandom 0.3.0
  shellwords 0.2.0
  singleton 0.2.0
  stringio 3.0.9
  strscan 3.0.7
  syntax_suggest 1.1.0
  tempfile 0.2.0
  time 0.3.0
  timeout 0.4.1
  tmpdir 0.2.0
  tsort 0.2.0
  un 0.3.0
  uri 0.13.0
  weakref 0.1.3
  win32ole 1.8.10
  yaml 0.3.0
  zlib 3.1.0


The following bundled gem is promoted from default gems.


  racc 1.7.3


The following bundled gems are updated.


  minitest 5.20.0
  rake 13.1.0
  test-unit 3.6.1
  rexml 3.2.6
  rss 0.3.0
  net-imap 0.4.4
  net-smtp 0.4.0
  rbs 3.2.2
  typeprof 0.21.8
  debug 1.8.0


See GitHub releases like Logger or
changelog for details of the default gems or bundled gems.

See NEWS
or commit logs
for more details.

With those changes, 5414 files changed, 306141 insertions(+), 183575 deletions(-)
since Ruby 3.2.0!

Download


  
    https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.tar.gz

    SIZE: 21783575
SHA1: c75a860e06f27b7f69b874757417277c21d1d3f4
SHA256: c4ff82395a90ef76c7f906b7687026e0ab96b094dcf3a532d9ab97784a073222
SHA512: 265fb2ffe55af47d8349edffcebe749cc170291227cef55529fe4e67363e4e84b88daa34ffb5364a99c8a0e32110266a34c9a11d62f3bd6f6d47fa76eca641f4
    
  
  
    https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.tar.xz

    SIZE: 16163884
SHA1: 26503f9bdc7d0a05aaa9836f54d3aa9e74a9ead9
SHA256: 051815637f1fa75a1edf2c54b66d5d5b69563daad777da8dc39543b7754b5290
SHA512: 82f4acfaad1dc47db27ee3eb952481a95b3474a98059e9e9f5ceb035b690d1faabe99f2ec52371c4089ed1615eb10c395f029088418fec4d26399b65b4f259b9
    
  
  
    https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.zip

    SIZE: 26735443
SHA1: 35583453a7734216b08829ef0ec9ea1bc0d4ae7f
SHA256: 56dd82e1dd714f2889ca975ae7befbe005675de08839c2cc4a484de2ae65201c
SHA512: 7fbe414c230aedc9f364512bcbc213038f8f6e4268929a559d2527e2f3e32a140b394e37098ab7e59161236eca8b89cc9e52d73a3be8d7bd44faa91681483f5d
    
  


What is Ruby

Ruby was first developed by Matz (Yukihiro Matsumoto) in 1993,
and is now developed as Open Source. It runs on multiple platforms
and is used all over the world especially for web development.

Posted by naruse on 11 Dec 2023

[content]
empty
[/content]

PublishedDate: 2023-12-11
Category: Technology
NewsPaper: Ruby (EN RSS)
{"id"=>4232,
"title"=>"Ruby 3.3.0-rc1 Released",
"summary"=>"\n

We are pleased to announce the release of Ruby 3.3.0-rc1. Ruby 3.3 adds a new parser named Prism, uses Lrama as a parser generator, adds a new pure-Ruby JIT compiler named RJIT, and many performance improvements especially YJIT.

\n\n

After the release of RC1, we will avoid introducing ABI incompatibilities wherever possible. If we need to do, we’ll announce it in the release note.

\n\n

Prism

\n\n
    \n
  • Introduced the Prism parser as a default gem\n
      \n
    • Prism is a portable, error tolerant, and maintainable recursive descent parser for the Ruby language
    • \n
    \n
  • \n
  • Prism is production ready and actively maintained, you can use it in place of Ripper\n
      \n
    • There is extensive documentation on how to use Prism
    • \n
    • Prism is both a C library that will be used internally by CRuby and a Ruby gem that can be used by any tooling which needs to parse Ruby code
    • \n
    • Notable methods in the Prism API are:\n
        \n
      • Prism.parse(source) which returns the AST as part of a ParseResult
      • \n
      • Prism.dump(source) which returns the serialized AST as a String
      • \n
      • Prism.parse_comments(source) which returns the comments
      • \n
      \n
    • \n
    \n
  • \n
  • You can make pull requests or issues directly on the Prism repository if you are interested in contributing
  • \n
\n\n

Use Lrama instead of Bison

\n\n\n\n

RJIT

\n\n
    \n
  • Introduced a pure-Ruby JIT compiler RJIT and replaced MJIT.\n
      \n
    • RJIT supports only x86-64 architecture on Unix platforms.
    • \n
    • Unlike MJIT, it doesn’t require a C compiler at runtime.
    • \n
    \n
  • \n
  • RJIT exists only for experimental purposes.\n
      \n
    • You should keep using YJIT in production.
    • \n
    \n
  • \n
  • If you are interested in developing JIT for Ruby, please check out k0kubun’s presentation on Day 3 of RubyKaigi.
  • \n
\n\n

YJIT

\n\n
    \n
  • Major performance improvements over 3.2\n
      \n
    • Support for splat and rest arguments has been improved.
    • \n
    • Registers are allocated for stack operations of the virtual machine.
    • \n
    • More calls with optional arguments are compiled.
    • \n
    • Exception handlers are also compiled.
    • \n
    • Instance variables no longer exit to the interpreter\nwith megamorphic object shapes.
    • \n
    • Unsupported call types no longer exit to the interpreter.
    • \n
    • Integer#!=, String#!=, Kernel#block_given?, Kernel#is_a?,\nKernel#instance_of?, Module#=== are specially optimized.
    • \n
    • Now more than 3x faster than the interpreter on optcarrot!
    • \n
    \n
  • \n
  • Significantly improved memory usage over 3.2\n
      \n
    • Metadata for compiled code uses a lot less memory.
    • \n
    • Generate more compact code on ARM64
    • \n
    \n
  • \n
  • Compilation speed is now slightly faster than 3.2.
  • \n
  • Add RubyVM::YJIT.enable that can enable YJIT at run-time\n
      \n
    • You can start YJIT without modifying command-line arguments or environment variables.
    • \n
    • This can also be used to enable YJIT only once your application is\ndone booting. --yjit-disable can be used if you want to use other\nYJIT options while disabling YJIT at boot.
    • \n
    \n
  • \n
  • Code GC is now disabled by default, and --yjit-exec-mem-size is treated\nas a hard limit where compilation of new code stops.\n
      \n
    • Better copy-on-write behavior on servers using unicorn and forking
    • \n
    • No sudden drops in performance due to code GC.
    • \n
    • You can still enable code GC if desired with --yjit-code-gc
    • \n
    \n
  • \n
  • ratio_in_yjit stat produced by --yjit-stats is now available in release builds,\na special stats or dev build is no longer required to access most stats.
  • \n
  • Exit tracing option now supports sampling\n
      \n
    • --trace-exits-sample-rate=N
    • \n
    \n
  • \n
  • --yjit-perf is added to facilitate profiling with Linux perf.
  • \n
  • More thorough testing and multiple bug fixes
  • \n
\n\n

M:N thread scheduler

\n\n
    \n
  • M:N thread scheduler was introduced. [Feature #19842]\n
      \n
    • M Ruby threads are managed by N native threads (OS threads) so the thread creation and management cost are reduced.
    • \n
    • It can break C-extension compatibility so that M:N thread scheduler is disabled on the main Ractor by default.\n
        \n
      • RUBY_MN_THREADS=1 environment variable enables M:N threads on the main Ractor.
      • \n
      • M:N threads are enabled on non-main Ractors.
      • \n
      \n
    • \n
    • RUBY_MAX_CPU=n environment variable sets maximum number of N (maximum number of native threads). The default value is 8.\n
        \n
      • Since only one Ruby thread per Ractor can run at the same time, the number of native threads will be used, which is the smaller of the number specified in RUBY_MAX_CPU and the number of running Ractors. So that single Ractor applications (most of applications) will use 1 native thread.
      • \n
      • To support blocking operations, more than N native threads can be used.
      • \n
      \n
    • \n
    \n
  • \n
\n\n

Other Notable New Features

\n\n

Language

\n\n

Performance improvements

\n\n
    \n
  • defined?(@ivar) is optimized with Object Shapes.
  • \n
  • Name resolution such as Socket.getaddrinfo can now be interrupted (in environments where pthreads are available). Feature #19965\n
      \n
    • For this purpose, a pthread is now created whenever calling getaddrinfo or getnameinfo. This incurs some overhead in name resolution (about 2.5x in our experiments). We do not expect the name resolution overhead to be a problem for most applications, but if you observe such, or if you see unexpected affects that you believe are due to this change, please report them.
    • \n
    \n
  • \n
  • Several performance improvements to the Garbage Collector\n
      \n
    • Young objects referenced by old objects are no longer immediately\n promoted to the old generation. This significantly reduces the frequency of\n major GC collections. [Feature #19678]
    • \n
    • A new REMEMBERED_WB_UNPROTECTED_OBJECTS_LIMIT_RATIO tuning variable was\n introduced to control the number of unprotected objects cause a major GC\n collection to trigger. The default is set to 0.01 (1%). This significantly\n reduces the frequency of major GC collection. [Feature #19571]
    • \n
    • Write Barriers were implemented for many core types that were missing them,\n notably Time, Enumerator, MatchData, Method, File::Stat, BigDecimal\n and several others. This significantly reduces minor GC collection time and major\n GC collection frequency.
    • \n
    • Most core classes are now using Variable Width Allocation, notably Hash, Time,\n Thread::Backtrace, Thread::Backtrace::Location, File::Stat, Method.\n This makes these classes faster to allocate and free, use less memory and reduce\n heap fragmentation.
    • \n
    • Support for weak references has been added to the garbage collector. [Feature #19783]
    • \n
    \n
  • \n
\n\n

Other notable changes since 3.2

\n\n

IRB

\n\n

IRB has received several enhancements, including but not limited to:

\n\n
    \n
  • Advanced irb:rdbg integration that provides an equivalent debugging experience to pry-byebug (doc).
  • \n
  • Pager support for ls, show_source and show_cmds commands.
  • \n
  • More accurate and helpful information provided by the ls and show_source commands.
  • \n
  • Experimental autocompletion using type analysis (doc).
  • \n
  • It is now possible to change the font color and font style in the completion dialog by a newly introduced class Reline::Face (doc)
  • \n
\n\n

In addition, IRB has also undergone extensive refactoring and received dozens of bug fixes to facilitate easier future enhancements.

\n\n

Compatibility issues

\n\n

Note: Excluding feature bug fixes.

\n\n
    \n
  • it calls without arguments in a block with no ordinary parameters are\ndeprecated. it will be a reference to the first block parameter in Ruby 3.4.\nFeature #18980
  • \n
\n\n

Removed constants

\n\n

The following deprecated constants are removed.

\n\n

Removed methods

\n\n

The following deprecated methods are removed.

\n\n

Removed environment variables

\n\n

The following deprecated environment variables are removed.

\n\n
    \n
  • Environment variable RUBY_GC_HEAP_INIT_SLOTS has been deprecated and is a no-op. Please use environment variables RUBY_GC_HEAP_{0,1,2,3,4}_INIT_SLOTS instead. Feature #19785
  • \n
\n\n

Stdlib compatibility issues

\n\n

ext/readline is retired

\n\n
    \n
  • We have reline that is pure Ruby implementation compatible with ext/readline API. We rely on reline in the future. If you need to use ext/readline, you can install ext/readline via rubygems.org with gem install readline-ext.
  • \n
  • We no longer need to install libraries like libreadline or libedit.
  • \n
\n\n

C API updates

\n\n

Updated C APIs

\n\n

The following APIs are updated.

\n\n

Removed C APIs

\n\n

The following deprecated APIs are removed.

\n\n

Standard library updates

\n\n

RubyGems and Bundler warn if users require gem that is scheduled to become the bundled gems in the future version of Ruby.

\n\n

Targeted libraries are:

\n
    \n
  • abbrev
  • \n
  • base64
  • \n
  • bigdecimal
  • \n
  • csv
  • \n
  • drb
  • \n
  • getoptlong
  • \n
  • mutex_m
  • \n
  • nkf
  • \n
  • observer
  • \n
  • racc
  • \n
  • resolv-replace
  • \n
  • rinda
  • \n
  • syslog
  • \n
\n\n

The following default gem is added.

\n\n
    \n
  • prism 0.15.1
  • \n
\n\n

The following default gems are updated.

\n\n
    \n
  • RubyGems 3.5.0.dev
  • \n
  • base64 0.2.0
  • \n
  • benchmark 0.3.0
  • \n
  • bigdecimal 3.1.5
  • \n
  • bundler 2.5.0.dev
  • \n
  • cgi 0.4.0
  • \n
  • csv 3.2.8
  • \n
  • date 3.3.4
  • \n
  • delegate 0.3.1
  • \n
  • drb 2.2.0
  • \n
  • english 0.8.0
  • \n
  • erb 4.0.3
  • \n
  • etc 1.4.3.dev.1
  • \n
  • fcntl 1.1.0
  • \n
  • fiddle 1.1.2
  • \n
  • fileutils 1.7.2
  • \n
  • find 0.2.0
  • \n
  • getoptlong 0.2.1
  • \n
  • io-console 0.6.1.dev
  • \n
  • irb 1.8.3
  • \n
  • logger 1.6.0
  • \n
  • mutex_m 0.2.0
  • \n
  • net-http 0.4.0
  • \n
  • net-protocol 0.2.2
  • \n
  • nkf 0.1.3
  • \n
  • observer 0.1.2
  • \n
  • open-uri 0.4.0
  • \n
  • open3 0.2.0
  • \n
  • openssl 3.2.0
  • \n
  • optparse 0.4.0
  • \n
  • ostruct 0.6.0
  • \n
  • pathname 0.3.0
  • \n
  • pp 0.5.0
  • \n
  • prettyprint 0.2.0
  • \n
  • pstore 0.1.3
  • \n
  • psych 5.1.1.1
  • \n
  • rdoc 6.6.0
  • \n
  • reline 0.3.9
  • \n
  • rinda 0.2.0
  • \n
  • securerandom 0.3.0
  • \n
  • shellwords 0.2.0
  • \n
  • singleton 0.2.0
  • \n
  • stringio 3.0.9
  • \n
  • strscan 3.0.7
  • \n
  • syntax_suggest 1.1.0
  • \n
  • tempfile 0.2.0
  • \n
  • time 0.3.0
  • \n
  • timeout 0.4.1
  • \n
  • tmpdir 0.2.0
  • \n
  • tsort 0.2.0
  • \n
  • un 0.3.0
  • \n
  • uri 0.13.0
  • \n
  • weakref 0.1.3
  • \n
  • win32ole 1.8.10
  • \n
  • yaml 0.3.0
  • \n
  • zlib 3.1.0
  • \n
\n\n

The following bundled gem is promoted from default gems.

\n\n
    \n
  • racc 1.7.3
  • \n
\n\n

The following bundled gems are updated.

\n\n
    \n
  • minitest 5.20.0
  • \n
  • rake 13.1.0
  • \n
  • test-unit 3.6.1
  • \n
  • rexml 3.2.6
  • \n
  • rss 0.3.0
  • \n
  • net-imap 0.4.4
  • \n
  • net-smtp 0.4.0
  • \n
  • rbs 3.2.2
  • \n
  • typeprof 0.21.8
  • \n
  • debug 1.8.0
  • \n
\n\n

See GitHub releases like Logger or\nchangelog for details of the default gems or bundled gems.

\n\n

See NEWS\nor commit logs\nfor more details.

\n\n

With those changes, 5414 files changed, 306141 insertions(+), 183575 deletions(-)\nsince Ruby 3.2.0!

\n\n

Download

\n\n
    \n
  • \n

    https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.tar.gz

    \n\n
    SIZE: 21783575\nSHA1: c75a860e06f27b7f69b874757417277c21d1d3f4\nSHA256: c4ff82395a90ef76c7f906b7687026e0ab96b094dcf3a532d9ab97784a073222\nSHA512: 265fb2ffe55af47d8349edffcebe749cc170291227cef55529fe4e67363e4e84b88daa34ffb5364a99c8a0e32110266a34c9a11d62f3bd6f6d47fa76eca641f4\n
    \n
  • \n
  • \n

    https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.tar.xz

    \n\n
    SIZE: 16163884\nSHA1: 26503f9bdc7d0a05aaa9836f54d3aa9e74a9ead9\nSHA256: 051815637f1fa75a1edf2c54b66d5d5b69563daad777da8dc39543b7754b5290\nSHA512: 82f4acfaad1dc47db27ee3eb952481a95b3474a98059e9e9f5ceb035b690d1faabe99f2ec52371c4089ed1615eb10c395f029088418fec4d26399b65b4f259b9\n
    \n
  • \n
  • \n

    https://cache.ruby-lang.org/pub/ruby/3.3/ruby-3.3.0-rc1.zip

    \n\n
    SIZE: 26735443\nSHA1: 35583453a7734216b08829ef0ec9ea1bc0d4ae7f\nSHA256: 56dd82e1dd714f2889ca975ae7befbe005675de08839c2cc4a484de2ae65201c\nSHA512: 7fbe414c230aedc9f364512bcbc213038f8f6e4268929a559d2527e2f3e32a140b394e37098ab7e59161236eca8b89cc9e52d73a3be8d7bd44faa91681483f5d\n
    \n
  • \n
\n\n

What is Ruby

\n\n

Ruby was first developed by Matz (Yukihiro Matsumoto) in 1993,\nand is now developed as Open Source. It runs on multiple platforms\nand is used all over the world especially for web development.

\n\n

Posted by naruse on 11 Dec 2023

",
"content"=>"",
"author"=>nil,
"link"=>"https://www.ruby-lang.org/en/news/2023/12/11/ruby-3-3-0-rc1-released/",
"published_date"=>Mon, 11 Dec 2023 00:00:00.000000000 UTC +00:00,
"image_url"=>nil,
"feed_url"=>"https://www.ruby-lang.org/en/news/2023/12/11/ruby-3-3-0-rc1-released/",
"language"=>nil,
"active"=>true,
"ricc_source"=>"feedjira::v1",
"created_at"=>Mon, 01 Apr 2024 20:13:37.696398000 UTC +00:00,
"updated_at"=>Mon, 21 Oct 2024 18:03:08.696254000 UTC +00:00,
"newspaper"=>"Ruby (EN RSS)",
"macro_region"=>"Technology"}
Edit this article
Back to articles