Fork Page | History

Ronin Web

Ronin Web is a Ruby library for Ronin that provides support for web scraping and spidering functionality.

Ronin is a Ruby platform for exploit development and security research. Ronin allows for the rapid development and distribution of code, exploits or payloads over many common Source-Code-Management (SCM) systems.

Ruby

Ronin's Ruby environment allows security researchers to leverage Ruby with ease. The Ruby environment contains a multitude of convenience methods for working with data in Ruby, a Ruby Object Database, a customized Ruby Console and an extendable command-line interface.

Extend

Ronin's more specialized features are provided by additional Ronin libraries, which users can choose to install. These libraries can allow one to write and run Exploits and Payloads, scan for PHP vulnerabilities, perform Google Dorks or run 3rd party scanners.

Publish

Ronin allows users to publish and share code, exploits, payloads or other data via Overlays. Overlays are directories of code and data that can be hosted on any SVN, Hg, Git or Rsync server. Ronin makes it easy to create, install or update Overlays.

Features

Synopsis

  • Start the Ronin console with Ronin Web preloaded: 
    $ ronin-web

Examples

  • Get a web-page: 
    Web.get('http://www.rubyinside.com/')
  • Get only the body of the web-page: 
    Web.get_body('http://www.rubyinside.com/')
  • Get a WWW::Mechanize agent: 
    agent = Web.agent
  • Parse HTML: 
    Web.html(open('some_file.html'))
# => <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
# <html>
#   <head>
#     <script type="text/javascript" src="redirect.js"></script>
#   </head>
# </html>
  • Build a HTML document: 
    doc = Web.build_html do
  html {
    head {
      script(:type => 'text/javascript', :src => 'redirect.js')
    }
  }
end

puts doc.to_html
# <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
# <html><head><script src="redirect.js" type="text/javascript"></script></head></html>
  • Parse XML: 
    Web.xml(some_text)
# => <?xml version="1.0"?>
# <users>
#   <user>
#     <name>admin</name>
#     <password>0mni</password>
#   </user>
# </users>
  • Build a XML document: 
    doc = Web.build_xml do
  playlist {
    mp3 {
      file { text('02 THE WAIT.mp3') }
      artist { text('Evil Nine') }
      track { text('The Wait feat David Autokratz') }
      duration { text('1000000000') }
    }
  }
end
    
puts doc.to_xml
# <?xml version="1.0"?>
# <playlist>
#   <mp3>
#     <file>02 THE WAIT.mp3</file>
#     <artist>Evil Nine</artist>
#     <track>The Wait feat David Autokratz</track>
#     <duration>1000000000</duration>
#   </mp3>
# </playlist>
  • Spider a web site: 
    Web::Spider.host('www.example.com') do |spider|
  spider.every_url do |url|
    # ...
  end

  spider.every_page do |page|
    # ...
  end
end
  • Serve files via a Web Server: 
    require 'ronin/web/server'

Web.server do
  file '/opensearch.xml', '/tmp/test.xml'
  directory '/download/', '/tmp/download/'
end

Web.server.get '/test' do
  'Test 1 2 1 2'
end

Requirements

Install

$ sudo gem install ronin-web

Development