delete tool/instruction.rb

Previous commit changed insns.def format. Now is the time for its
generators. In doing so I chose to modernize the system, not just
patch.  My attempt includes

- extensive use of Onigumo regular expressions
- split from one big file (instruction.rb) into separated MVC
- partial view

Also, let me take this opportunity to kill old unused features
such as

- stack caching
- minsns / yasmdata which are never seriously used
- yarvarch document generation (moved to doc/)
- vast majority of unused arguments to insns2vm.rb

This commit generates VM source codes that cleanly compile, and
the generated binary passes tests.  At least for me.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@61733 b2dd03c8-39d4-4d8f-98ff-823fe69b080e

1 files changed, 49 insertions, 0 deletions

diff --git a/tool/ruby_vm/helpers/scanner.rb b/tool/ruby_vm/helpers/scanner.rb
new file mode 100644
index 0000000000..3dce6ffdfe
--- /dev/null
+++ b/tool/ruby_vm/helpers/scanner.rb
@@ -0,0 +1,49 @@
+#! /your/favourite/path/to/ruby
+# -*- mode: ruby; coding: utf-8; indent-tabs-mode: nil; ruby-indent-level: 2 -*-
+# -*- frozen_string_literal: true; -*-
+# -*- warn_indent: true; -*-
+#
+# Copyright (c) 2017 Urabe, Shyouhei.  All rights reserved.
+#
+# This file is  a part of the programming language  Ruby.  Permission is hereby
+# granted, to  either redistribute and/or  modify this file, provided  that the
+# conditions  mentioned in  the file  COPYING are  met.  Consult  the file  for
+# details.
+
+require 'pathname'
+require 'strscan'
+
+class RubyVM::Scanner
+  attr_reader :__FILE__
+  attr_reader :__LINE__
+
+  def initialize path
+    src       = Pathname.new __dir__
+    src      += path
+    @__LINE__ = 1
+    @__FILE__ = src.realpath.to_path
+    str       = src.read mode: 'rt:utf-8:utf-8'
+    @scanner  = StringScanner.new str
+  end
+
+  def eos?
+    @scanner.eos?
+  end
+
+  def scan re
+    ret   = @__LINE__
+    match = @scanner.scan re
+    return unless match
+    @__LINE__ += match.count "\n"
+    return ret
+  end
+
+  def scan! re
+    scan re or raise sprintf "parse error at %s:%d near:\n %s...", \
+        @__FILE__, @__LINE__, @scanner.peek(32)
+  end
+
+  def [] key
+    return @scanner[key]
+  end
+end