delete tool/instruction.rb (2nd try)

Previous commit changed insns.def format. Now is the time for its
generators. In doing so I chose to modernize the system, not just
patch.  My attempt includes

- extensive use of Onigumo regular expressions
- split from one big file (instruction.rb) into separated MVC
- partial view

Also, let me take this opportunity to kill old unused features
such as

- stack caching
- minsns / yasmdata which are never seriously used
- yarvarch document generation (moved to doc/)
- vast majority of unused arguments to insns2vm.rb

This commit generates VM source codes that cleanly compile, and
the generated binary passes tests.  At least for me.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@61784 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

1 files changed, 57 insertions, 0 deletions

diff --git a/tool/ruby_vm/loaders/opt_operand_def.rb b/tool/ruby_vm/loaders/opt_operand_def.rb
new file mode 100644
index 0000000000..5c94b4bced
--- /dev/null
+++ b/tool/ruby_vm/loaders/opt_operand_def.rb
@@ -0,0 +1,57 @@
+#! /your/favourite/path/to/ruby
+# -*- mode: ruby; coding: utf-8; indent-tabs-mode: nil; ruby-indent-level: 2 -*-
+# -*- frozen_string_literal: true; -*-
+# -*- warn_indent: true; -*-
+#
+# Copyright (c) 2017 Urabe, Shyouhei.  All rights reserved.
+#
+# This file is  a part of the programming language  Ruby.  Permission is hereby
+# granted, to  either redistribute and/or  modify this file, provided  that the
+# conditions  mentioned in  the file  COPYING are  met.  Consult  the file  for
+# details.
+
+require_relative '../helpers/scanner'
+
+json    = []
+scanner = RubyVM::Scanner.new '../../../defs/opt_operand.def'
+path    = scanner.__FILE__
+grammar = %r/
+    (?<comment> \# .+? \n                      ){0}
+    (?<ws>      \g<comment> | \s               ){0}
+    (?<insn>    \w+                            ){0}
+    (?<paren>   \( (?: \g<paren> | [^()]+)* \) ){0}
+    (?<expr>    (?: \g<paren> | [^(),\ \n] )+  ){0}
+    (?<remain>  \g<expr>                       ){0}
+    (?<arg>     \g<expr>                       ){0}
+    (?<extra>   , \g<ws>* \g<remain>           ){0}
+    (?<args>    \g<arg> \g<extra>*             ){0}
+    (?<decl>    \g<insn> \g<ws>+ \g<args> \n   ){0}
+/mx
+
+until scanner.eos? do
+  break if scanner.scan(/ ^ __END__ $ /x)
+  next  if scanner.scan(/#{grammar} \g<ws>+ /ox)
+
+  line = scanner.scan!(/#{grammar} \g<decl> /mox)
+  insn = scanner["insn"]
+  args = scanner["args"]
+  ary  = []
+  until args.strip.empty? do
+    tmp = StringScanner.new args
+    tmp.scan(/#{grammar} \g<args> /mox)
+    ary << tmp["arg"]
+    args = tmp["remain"]
+    break unless args
+  end
+  json << {
+    location: [path, line],
+    signature: [insn, ary]
+  }
+end
+
+RubyVM::OptOperandDef = json
+
+if __FILE__ == $0 then
+  require 'json'
+  JSON.dump RubyVM::OptOperandDef, STDOUT
+end