Feed aggregator
cannot import name MAXREPEAT
When I upgraded from Xubuntu 12.10 to 13.04 today, all my existing Python virtualenvs broke! Fortunately, they're just virtualenvs and easy to replace (that's kind of the point). But don't panic if you start seeing these.
$ ipython
Traceback (most recent call last):
File "/home/catherine/ve/e2/bin/ipython", line 5, in
from pkg_resources import load_entry_point
File "build/bdist.linux-i686/egg/pkg_resources.py", line 16, in
File "/home/catherine/ve/e2/lib/python2.7/re.py", line 105, in
import sre_compile
File "/home/catherine/ve/e2/lib/python2.7/sre_compile.py", line 14, in
import sre_parse
File "/home/catherine/ve/e2/lib/python2.7/sre_parse.py", line 17, in
from sre_constants import *
File "/home/catherine/ve/e2/lib/python2.7/sre_constants.py", line 18, in
from _sre import MAXREPEAT
ImportError: cannot import name MAXREPEAT
Apparently Python 2.7.4 introduces _sre.MAXREPEAT. Here it is in my (new) system Python, 2.7.4:
Python 2.7.4 (default, Apr 19 2013, 18:28:01)
[GCC 4.7.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import _sre
>>> _sre.MAXREPEAT
4294967295L
... but the virtualenvs I created before the upgrade still use Python 2.7.3
Python 2.7.3 (default, Sep 26 2012, 21:51:14)
[GCC 4.7.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import _sre
>>> _sre.MAXREPEAT
Traceback (most recent call last):
File "", line 1, in
AttributeError: 'module' object has no attribute 'MAXREPEAT'
If I were a deeper hacker I'd try to figure out why code running within my old virtualenvs is trying to access a 2.7.4-only attribute, or what's the most efficient way to recover my old virtualenvs. But I'll settle for recognizing the problem and spinning up new virtualenvs instead. That fixes the problem.
I know... I could have avoided this problem by using Python 3! I've got code that depends on fabric, though, which still isn't available for 3.
Oracle internals web site
This is a good web site with Oracle internals information:
http://www.ixora.com.au/notes/
I’ve benefited from this one for years.
- Bobby
Online retailers have 3 seconds to make mom happy.
Mothers day is coming up fast. May 12th 2013 is just around the corner and If you have not already done so, make sure you go out and get mom a special gift as soon as possible. If you need a hand picking something great, take a look at this mothers day gift guide by the HuffingtonPost
Many this year like they have in previous years shopped online and bought mom that special gift from an online retailer, a simple, easy and fun process. But is it always? Unfortunately for many, the experience did not live up to expectation due to site performance and both customers and merchants end up losing.
Is this a big deal? We put together this infograph on mothers day shopping. Take a look.
Raw Devices...
If you are using RAW devices for your database (no ASM, no filesystem - just 'raw') - please drop me a line and let me know. Include the size of your database as well please.
thanks!
Demand for meaning from big data continues to rise
Effective business decision-making has come to depend on real-time access to business intelligence (BI) analytics, which offer firms deep insight into particular processes, customer behaviors or market trends. However, that capability has become a challenge in the face of ever-expanding big data, which many enterprises are looking to overcome. According to industry experts, in order to harness this information for meaningful application, firms need to take a more strategic approach with the support of robust BI solutions and database experts.
A series of reports recently released by Aberdeen studied how corporations are struggling with big data while the demand for fast access to analytics is rapidly accelerating. Nathaniel Rowe, an Aberdeen analyst, argued that firms need to delve more deeply into business metrics and customer desires. He recommended investing in real-time integration tools that can allow companies to rapidly incorporate raw data for analysis, thus fueling faster and higher quality decisions. Rowe revealed that organizations using these tools are able to deliver timely information 89 percent of the time, while this is only possible 73 percent of the time without such tools.
Rowe also suggested that evaluating supplementary integration technologies may be useful, especially since modern IT environments are constantly evolving and becoming more complex. Ideally, he asserted that enterprises should deploy a single skilled professional or team of such experts, such as DBA services, to meet big data needs. According to Rowe, organizations that do so are able to reduce integration costs while sustaining productivity.
Taking a unique approach
Wired contributor Doron Aspitz reported that the majority of legacy BI tools fail to efficiently and accurately interpret big data. Enterprises are bogged down by a multitude of reports, all of which break down data but don't offer actionable insight that can have any kind of impact or concrete results. To create ROI from BI solutions, Aspitz argued that firms need to deploy the most advanced tools and expert advise for analyzing information in a way that fits the business' specific domain. He explained that by doing this, companies can better understand what information specific to the industry is most valuable based on trends and patterns within the market.
There is no one approach to harnessing big data that can work for all organizations. The most effective BI solutions and experts can not only interpret large stores of data, but also provide context around the information for more relevant events and a more holistic understanding.
RDX's business intelligence and big data experts assist customers in leveraging data contained in large data stores. For more information, please visit our Business Intelligence and Predictive Analytics pages or contact us.
That Brazilian Sensation - Customer Spotlight
The first is Telefonica|Vivo. Telefonica SA is a Spain-based company active in the telecommunications and digital services sectors. The Company operates through three business segments: Telefonica Latin America, Tefonica Europa, and Others. It provides public and private telecommunication, media and entertainment services; under such brands as Telefonica, Movistar, O2 and Vivo, among others.
Telefonica is a loyal Oracle customer with many Oracle products in use.
A group of us from Oracle met with Daniel and Jorge from
Telefonica and provided us with a tour of their data center. Pictured below is the group from Oracle and
Telefonica (from left to right: Selma Snaider and Erivaldo Sousa (Oracle), Jorge and Daniel Soares de Barros (Telefonica), and Lauren Diehl (Oracle). (used with permission)
It was an amazing experience to be provided a tour of their data center. Below is a photo of their operations center along with the build-out of an additional 23,000 sq meter wing for increased capacity. (used with permission)
Many thanks to Daniel and Jorge for the tour. It was fantastic.
My second customer introduction was with Odebrecht. The company consists of diversified businesses catering to engineering and construction, investments in infrastructure and energy, industry, and supporting institutions sectors through its subsidiaries. The company holds expertise in the areas of energy, industrial engineering, infrastructure, oil and gas, real estate developments, environmental engineering, transportation and logistics, defense and technology, chemical and petrochemical, ethanol and sugar production, and investments and holdings, among others. Odebrecht operates along with its subsidiaries in several countries across the Americas, Europe, Middle East and Asia. Odebrecht is headquartered in Salvador, Brazil.
Odebrecht is another loyal Oracle customer with a very large Oracle product footprint.
Our Oracle team met with Alexsandre Bisetto during lunch and sat down in order to talk about current account team successes and related support opportunities.
Thank you Alexsandre for spending time with us.
I thoroughly enjoy getting to meet our customers no matter where I travel. Most of all, l like hearing about how our customers are using Oracle products to run their businesses. It makes me proud to work for a global company helping other global companies like those mentioned, succeed.
Finally, I met with an amazing Oracle team of Support Account Managers and staff (below) at our Sao Paulo office and facilitated a successful workshop. I look forward to my next visit.
New Version Of XPLAN_ASH Tool - Video Tutorial
You can download the latest version here.
In addition to many changes to the way the information is presented and many other smaller changes to functionality there is one major new feature: XPLAN_ASH now also supports S-ASH, the free ASH implementation.
If you run XPLAN_ASH in a S-ASH repository owner schema, it will automatically detect that and adjust accordingly.
XPLAN_ASH was tested against the latest stable version of S-ASH (2.3). There are some minor changes required to that S-ASH release in order to function properly with XPLAN_ASH. Most of them will be included in the next S-ASH release as they really are only minor and don't influence the general S-ASH functionality at all.
If you're interested in using XPLAN_ASH with an existing S-ASH installation get in touch with me so I can provide the necessary scripts that apply the necessary changes.
Rather than writing another lengthy blog post about the changes and new features introduced I thought I start a multi-part video tutorial where I explain the purpose of the tool and how to use it based on the new version - some parts of the tutorial will focus on specific functionality of the tool and are therefore probably also quite useful as some kind of general tutorial on that Oracle feature and SQL execution troubleshooting guide in general.
The tutorial will consist of six parts initially, the first two are already available - the next ones to follow over time.
Part 1: Introduction, Overview
Part 2: Usage, Parameters, Invocation
Part 3: Rowsource Statistics: TBD
Part 4: Active Session History: TBD
Part 5: Systematic Parallel Execution Skew Analysis & Troubleshooting: Coming Soon
Part 6: Experimental Stuff, Script Configuration And Internals: TBD
Feel free to post questions/requests for clarification that are not covered in the tutorials in the comments section - if there are topics of general interest I might publish a seventh part addressing those questions.
In future I might use that video style more often since it's a nicer way of conveying certain kind of information.
WebCenter Partners Week: Lingotek
LINGOTEK Use Case for a Global Company Using Oracle WebCenter By Calvin Scharffs VP of Marketing @ Lingotek
Challenge With a presence in over 100 companies around the world, the global company needed to equip workers in all locations with customized, localized marketing messages, while providing headquarters with the ability to synchronize messages. The solution should be simple, scalable and cost-effective.
Solution The global company launched a worldwide web site localization project with Lingotek Inside Oracle WebCenter that enabled the translation and localization of content into 16 languages, with room to scale.
Benefits Translation and localization now happen in a matter of seconds rather than days. Expected ROI of more than 400 percent as a result of implementing Lingotek’s in-workflow translation technologies.
Managing Global Workflow The global company provides global customers with IT systems that are virtualized, automated, cloud-ready and sustainable. In addition to working with other global companies, the company itself has a presence all over the world, conducting business in more than 100 countries and regions.
With such a large footprint, the company needed a way to communicate its corporate and product messages in a unified way to different regions. In order to provide its highly regarded storage virtualization services around the world and in many languages, the company needed a simple, cost-effective way to translate its content.
The translation technology should be able to manage large amounts of data and automate workflows across a centralized system of record. Field workers in each country should have the resources they need in order to market the company’s products and services according to local culture and consumption patterns. The company had to simultaneously provide its corporate team with a centralized way to synchronize global messages.
In order to accomplish these needs, which were to take place on a massive scale, the company embarked on a worldwide web site localization project. One of the key strategies in this effort was the translation and localization of content. The company wanted to start by translating its content into 16 languages, with the option of more as the company expanded into new countries.
Elaborate International Workflow Needs Professional translation services were not only expensive, but interrupted the company’s rapidly evolving translation workflow. The company produced a continuous stream of content with which translation services had to keep pace. The company content included everything from web site content to social media, and the company’s website content alone changed 50-100 times a month.
Pure machine translation wouldn't work either. The company needed highly accurate translations that could adapt to the specifics of local languages and their unique nuances. It was extremely important to ensure that all contingents were saying the same things in the same ways, despite varying languages. This included ensuring that idioms and metaphors were translated appropriately so that they did not lose their meaning in the switch to a new language.
In-Workflow Translation Generates Real-Time Results The company selected Lingotek’s award-winning translation management system to continuously and automatically translate its global content, in real time. The company, already an Oracle WebCenter customer, benefitted from the fact that Lingotek’s translation platform is embedded in Oracle WebCenter. The company was able to localize its content for each of its global markets without leaving Oracle’s content management system.
Lingotek enables the company to take advantage of several possible workflows. They are automatic machine translation, community (customer or employee-based) translation and professional translation. Together, these workflows enable seamless multilingual publishing, automatically and in real time.
Infinite Scaling, Immediate Localization Lingotek’s automation kicks off translation workflow whenever the company’ corporate web site changes. This ensures that the company’ global sites are always synchronized, even though many incremental changes to content take place daily. Lingotek’s automation makes all translation fully scalable.
In a boon to the company field teams worldwide, Lingotek’s community features allow for local input, localizing content in real time. Thanks to the community component, the company can add new languages without hiring additional people to help translate content. Moreover, Lingotek's interface in the field is extremely easy to use and also enables field teams to edit content as needed to be congruent with local customs. Immediate Quadrupling of ROI
By harnessing Lingotek’s unique ability to engage a community and publish translations in real-time, the company saved significant time and money. The company has empowered its corporate and global branches to reach out to specific audiences and markets with relevant content. The end result is an enhanced bottom line. The company expects a potential ROI of over 400 percent from the implementation of Lingotek's technology.
Join Us for a Webinar to Learn More5 Steps to Open Your Website to a Global Audience with Oracle WebCenter Sites Wednesday, May 15, 2013 at 1:00 pm EST
Presenting your web content in a single language will limit your success. To build a global brand, businesses need to create a web experience that is accessible in many languages. Calvin Scharffs, Lingotek’s VP of Marketing, will demonstrate how to build a multilingual content presentation using Lingotek’s Global Web Experience Management solution, cloud-based software that utilizes Discovery, Analytics and Automation. Lingotek experts will show you how to manage a multilingual content Oracle WebCenter Sites site, synchronize the site’s content and manage changes in a continuous publishing model.
In this webinar, Calvin will walk you through the five steps needed to produce and maintain a multilingual website, including how to:
- Easily manage your multilingual sites
- Synchronize content and manage changes
- Translate content on the fly
- Use your community to translate
- When needed, professionally translate the content on your site
<span id="XinhaEditingPostion"></span>
12.00
Can't please everyone, I suppose
Hundreds of people take these quizzes each day. Since that time, over 670,000 answers have been submitted by thousands of Oracle technologists.
But you can't please everyone. I received this outraged message yesterday regarding the PL/SQL Challenge.:
This was the utmost bad joke on me. Would you be so kind to make clear your statement? My experience on the site was out of the limits of the common sense. No question but a popup nightmare required. Kindly please do something. This site is BAD, BAD, BAD. The worst I have ever seen in overall behavior!
I try not to take such criticism personally, though this did seem a bit harsh.
Well, I asked for clarification. I suggested that maybe the problem lies somewhere in his computer or network.
:-)
Let's see what he says, if he replies.
Important !! Clustering Factor Calculation Improvement (Fix You)
Oracle BI Apps 11.1.1.7.1 Available
You can download the software here.
The documentation library can be accessed here.
Some of the highlights of this release of Oracle BI Apps are:
- New applications, including Student Information Analytics, that provides an integrated view of admissions and recruiting, student records and student financials. It is certified with PeopleSoft Campus Solutions 9.0 (Bundle # 25), and Indirect Spend Planning, that enables procurement teams to forecast indirect spend, and use packaged what-if modeling tools to reduce spend.
- Content enhancements to Financials, HR, Projects, CRM, Procurement and Spend Planning, and Supply Chain & Order Management Applications.
- New TCO (Total Cost of Ownership) tools, including a GUI based configuration and a functional setup tool.
- This version of BI Apps is based on the technology infrastructure of the Oracle BI EE 11.1.1.7.0 release.
- As an optional feature to this release, an enhanced ETL architecture using Oracle Golden Gate is now available.
- These BI Applications are now available with the next-generational ELT architecture of ODI (Oracle Data Integrator)
Goodies - APEX 4.2.2 included Libraries
One of the advantages of applying the latest patches is that the external libraries that come with APEX carry an update too. Most known examples of external libraries are AnyChart (chart engine in APEX) and the CKEditor (Rich Text Editor), but there are some other nice libraries that come with APEX too.
Here's an overview of the libraries that you will find in the images folder:
Some are declaratively integrated in APEX for example respond-js is part of the Blue Responsive theme, some others are not, for example twitter-bootstrap and another part is used in some sample or packaged apps, for example jquery-flot.
Having those libraries already there, means you can more easily integrate those in your own apps yourself too. Remember, if you want to go the extra mile it's worthwhile to create an APEX plugin so it's easier to reuse.
If you want to know more about those libraries, you find the links below:
Library(latest) version in APEXLatest version of library960.gs120203130207bgiframe2.1.12.1.2ckeditor3.6.44.1.1codemirror0.663.12ios-inspired-theme121106121106jquery1.7.11.9.1 / 2.0.0 (no support IE6/7/8)jquery-autocomplete1.1deprecated - part of jQuery UIjquery-colorpicker1.41.4jquery-flot0.70.8jquery-jstree0.9.9a2pre 1.0 fix 2jquery-mobile1.2.11.3.1jquery-qtip22.0-6.26.20112.0.1jquery-quicksand1.2.21.3jquery-ui1.8.221.10.3jquery-validate1.71.11.1modernizr2.5.32.6.2respond-js1.1.01.1.0selectivizr1.0.21.0.2twitter-bootstrap2.2.12.3.1
So note that APEX is not always including the latest version of the library.
Learned a little bit about importing data from MySQL into HDFS using Sqoop
I assume my data in mysql
[surachart@centos ~]$ mysql -u surachart mydb -p < a.sql
Enter password:
[surachart@centos ~]$ mysql -u surachart mydb -p
Enter password:
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 10
Server version: 5.1.69 Source distribution
Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> select count(*) from mytable;
+----------+
| count(*) |
+----------+
| 1295462 |
+----------+
1 row in set (0.00 sec)
mysql>After I have my data, I download Sqoop (binary) and test it.
[surachart@centos ~]$ ls sqoop-1.4.3.bin__hadoop-0.20.tar.gz
sqoop-1.4.3.bin__hadoop-0.20.tar.gz
[surachart@centos ~]$ tar zxf sqoop-1.4.3.bin__hadoop-0.20.tar.gz
[surachart@centos ~]$ cd sqoop-1.4.3.bin__hadoop-0.20
[surachart@centos sqoop-1.4.3.bin__hadoop-0.20]$ cd bin/
[surachart@centos bin]$ pwd
/home/surachart/sqoop-1.4.3.bin__hadoop-0.20/bin
[surachart@centos bin]$ ./sqoop
Error: /usr/lib/hadoop does not exist!
Please set $HADOOP_COMMON_HOME to the root of your Hadoop installation.
[surachart@centos bin]$ export HADOOP_COMMON_HOME=/usr
[surachart@centos bin]$ ./sqoop
Error: /usr/lib/hadoop-mapreduce does not exist!
Please set $HADOOP_MAPRED_HOME to the root of your Hadoop MapReduce installation.
[surachart@centos bin]$ export HADOOP_MAPRED_HOME=/usr
[surachart@centos bin]$ ./sqoop
Warning: /usr/lib/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Try 'sqoop help' for usage.
[surachart@centos bin]$ export HBASE_HOME=/home/surachart/hbase
[surachart@centos bin]$ ./sqoop
Try 'sqoop help' for usage.
[surachart@centos bin]$ ./sqoop help
usage: sqoop COMMAND [ARGS]
Available commands:
codegen Generate code to interact with database records
create-hive-table Import a table definition into Hive
eval Evaluate a SQL statement and display the results
export Export an HDFS directory to a database table
help List available commands
import Import a table from a database to HDFS
import-all-tables Import tables from a database to HDFS
job Work with saved jobs
list-databases List available databases on a server
list-tables List available tables in a database
merge Merge results of incremental imports
metastore Run a standalone Sqoop metastore
version Display version information
See 'sqoop help COMMAND' for information on a specific command.
[surachart@centos bin]$ hadoop fs -mkdir /user/surachart/import
[surachart@centos bin]$ hadoop fs -ls /user/surachart/import
[surachart@centos bin]$
[surachart@centos bin]$ ./sqoop import -m 1 --connect jdbc:mysql://localhost:3306/mydb --username surachart --password password --table mytable --target-dir /user/surachart/import
13/05/08 12:11:42 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
13/05/08 12:11:42 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
13/05/08 12:11:42 INFO tool.CodeGenTool: Beginning code generation
13/05/08 12:11:43 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver
java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver
at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:716)
at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:605)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:628)
at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:235)
at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:219)
at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:283)
at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1255)
at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1072)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
at org.apache.sqoop.Sqoop.main(Sqoop.java:238)Note: On Sqoop no mysql lib, So Download "mysql-connector-java-5.1.25" on http://dev.mysql.com/downloads/connector/j/ and copy it to sqoop lib path.
[surachart@centos ~]$ ls mysql-connector-java-5.1.25.zip
mysql-connector-java-5.1.25.zip
[surachart@centos ~]$ unzip mysql-connector-java-5.1.25.zip
[surachart@centos ~]$ cp mysql-connector-java-5.1.25/mysql-connector-java-5.1.25-bin.jar sqoop-1.4.3.bin__hadoop-0.20/lib/After everything should be fine. Try again.
[surachart@centos ~]$ cd sqoop-1.4.3.bin__hadoop-0.20/bin/
[surachart@centos bin]$ ./sqoop import --direct -m 1 --connect jdbc:mysql://localhost:3306/mydb --username surachart --password password --table mytable --target-dir /user/surachart/import
13/05/08 12:27:54 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
13/05/08 12:27:54 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
13/05/08 12:27:54 INFO tool.CodeGenTool: Beginning code generation
13/05/08 12:27:56 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `mytable` AS t LIMIT 1
13/05/08 12:27:56 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `mytable` AS t LIMIT 1
13/05/08 12:27:56 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr
Note: /tmp/sqoop-surachart/compile/7d652c85de6562a56d07c0b4017e3cd4/mytable.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
13/05/08 12:28:04 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-surachart/compile/7d652c85de6562a56d07c0b4017e3cd4/mytable.jar
13/05/08 12:28:04 INFO manager.DirectMySQLManager: Beginning mysqldump fast path import
13/05/08 12:28:04 INFO mapreduce.ImportJobBase: Beginning import of mytable
13/05/08 12:28:10 INFO mapred.JobClient: Cleaning up the staging area hdfs://centos:8020/user/surachart/.staging/job_201305081226_0002
13/05/08 12:28:10 ERROR security.UserGroupInformation: PriviledgedActionException as:surachart cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory /user/surachart/import already exists
13/05/08 12:28:10 ERROR tool.ImportTool: Encountered IOException running import job: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory /user/surachart/import already exists
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:137)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:949)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:173)
at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:151)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:221)
at org.apache.sqoop.manager.DirectMySQLManager.importTable(DirectMySQLManager.java:92)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:403)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
[surachart@centos bin]$ ./sqoop import --direct -m 1 --connect jdbc:mysql://localhost:3306/mydb --username surachart --password password --table mytable --target-dir /user/surachart/import/mytable
13/05/08 12:28:23 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
13/05/08 12:28:24 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
13/05/08 12:28:24 INFO tool.CodeGenTool: Beginning code generation
13/05/08 12:28:26 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `mytable` AS t LIMIT 1
13/05/08 12:28:26 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `mytable` AS t LIMIT 1
13/05/08 12:28:26 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr
Note: /tmp/sqoop-surachart/compile/98909e84f7e2215902ebdbcca40cfa9f/mytable.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
13/05/08 12:28:33 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-surachart/compile/98909e84f7e2215902ebdbcca40cfa9f/mytable.jar
13/05/08 12:28:34 INFO manager.DirectMySQLManager: Beginning mysqldump fast path import
13/05/08 12:28:34 INFO mapreduce.ImportJobBase: Beginning import of mytable
13/05/08 12:28:42 INFO mapred.JobClient: Running job: job_201305081226_0003
13/05/08 12:28:43 INFO mapred.JobClient: map 0% reduce 0%
13/05/08 12:29:34 INFO mapred.JobClient: map 100% reduce 0%
13/05/08 12:29:56 INFO mapred.JobClient: Job complete: job_201305081226_0003
13/05/08 12:29:56 INFO mapred.JobClient: Counters: 18
13/05/08 12:29:56 INFO mapred.JobClient: Job Counters
13/05/08 12:29:56 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=54352
13/05/08 12:29:56 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0
13/05/08 12:29:56 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
13/05/08 12:29:56 INFO mapred.JobClient: Launched map tasks=1
13/05/08 12:29:56 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
13/05/08 12:29:56 INFO mapred.JobClient: File Output Format Counters
13/05/08 12:29:56 INFO mapred.JobClient: Bytes Written=23687032
13/05/08 12:29:56 INFO mapred.JobClient: FileSystemCounters
13/05/08 12:29:56 INFO mapred.JobClient: HDFS_BYTES_READ=87
13/05/08 12:29:56 INFO mapred.JobClient: FILE_BYTES_WRITTEN=36476
13/05/08 12:29:56 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=23687032
13/05/08 12:29:56 INFO mapred.JobClient: File Input Format Counters
13/05/08 12:29:56 INFO mapred.JobClient: Bytes Read=0
13/05/08 12:29:56 INFO mapred.JobClient: Map-Reduce Framework
13/05/08 12:29:56 INFO mapred.JobClient: Map input records=1
13/05/08 12:29:56 INFO mapred.JobClient: Physical memory (bytes) snapshot=73830400
13/05/08 12:29:56 INFO mapred.JobClient: Spilled Records=0
13/05/08 12:29:56 INFO mapred.JobClient: CPU time spent (ms)=16210
13/05/08 12:29:56 INFO mapred.JobClient: Total committed heap usage (bytes)=29818880
13/05/08 12:29:56 INFO mapred.JobClient: Virtual memory (bytes) snapshot=1179168768
13/05/08 12:29:56 INFO mapred.JobClient: Map output records=1295462
13/05/08 12:29:56 INFO mapred.JobClient: SPLIT_RAW_BYTES=87
13/05/08 12:29:56 INFO mapreduce.ImportJobBase: Transferred 22.5897 MB in 81.613 seconds (283.4336 KB/sec)
13/05/08 12:29:56 INFO mapreduce.ImportJobBase: Retrieved 1295462 records.
Check data in HDFS.
[surachart@centos bin]$ hadoop fs -ls /user/surachart/import
Found 1 items
drwx------ - surachart surachart 0 2013-05-08 12:29 /user/surachart/import/mytable
[surachart@centos bin]$ hadoop fs -ls /user/surachart/import/mytable
Found 2 items
-rw------- 3 surachart surachart 0 2013-05-08 12:29 /user/surachart/import/mytable/_SUCCESS
-rw------- 3 surachart surachart 23687032 2013-05-08 12:29 /user/surachart/import/mytable/part-m-00000Note: data in /user/surachart/import/mytable/part-m-00000 file, that is CSV type.
Written By: Surachart Opun http://surachartopun.com
Complicated IT environment increasing the importance of DBAs
Inarguably, the data center has been transforming as enterprises look to adopt new technologies for a competitive edge, such as cloud computing and bring-your-own-device policies, while also mining large volumes of big data. As the IT environment becomes more complicated, firms are requiring database experts and administrators to aid in managing these challenges.
Andrew Hillier, the CTO and co-founder of CiRBA, told ITWorld that traditionally, databases were run using a combination of internal corporate knowledge around historical issues, device-specific analytics and process performance analytics. Now, though, enterprises are looking to manage data centers as a whole. Hillier explained that new technologies have allowed firms to manage these components as a single entity for improved analytics and enhanced insight into information. This is especially true, he noted, for organizations that are migrating from a conventional computing environment to a private cloud infrastructure. As a result of this shift, Hillier revealed that people can gain a deeper comprehension of monitoring and analytics tools as data centers become more centrally controlled. However, this integrated approach to database management also brings a need for technical expertise, according to Hillier. For example, businesses working to manage virtualized hardware will need to leverage remote database support in order to understand CPU utilization and capacity planning.
The value of DBAs
Enterprise Apps Today reported that according to Bert Scalzo, database domain expert for Quest Software, big data has completely changed the role that the database administrator (DBA) plays in many corporations. He asserted that the DBA's role has become more important because may companies are accumulating terabytes and petabytes of data due to inexpensive cloud storage capabilities.
"It's not that the number of DBAs is decreasing, but the amount of data that companies are keeping is increasing exponentially with the same amount of resources," Scalzo explained to the source.
Gwen Shapira, senior database administrator at data infrastructure management company Pythian, also reportedly believed that there is a considerable opportunity for DBAs to address big data obstacles.
"A few years ago, executives only noticed the database when it stopped working," Shapira said, according to Enterprise Apps Today. "Now they are looking at the database and they think of all the information it holds as an opportunity: How can we get more value out of the information we have here? What other information can we collect to support our decision making?"
Harnessing big data will likely continue to drive a need for expert knowledge and new solutions, such as those provided by DBA services.
RDX is a leading provider of advanced remote database management and monitoring solutions. For more information about database administration and management, please visit our Services page or contact us.
Oracle Database Appliance 2.6 Is now Available
This release also has an offline configuration Tool that will work with Virtualized and Non Virtualized ODA Configurations. This provides a lot of help in upfront planning and configuration of the Database Appliance.
The offline configurator is available on Oracle Technology Network and can be downloaded here.
The Configurator now asks a set of Questions like Environment and Hardware to determine deployment and network structure to use.
From the patching perspective ODA 2.6 Offers a few enhancementsFor the Virtualized Platform
1. Remote Template Support
2. Support for Assemblies i.e .ova Support
3. a GUI VM Console can be accessed via oakcli
For Bare Metal (aka Non Virtualized)
1. SAP Application deployment is supported
2. PSU Patch
3. Unified Patch for Both V1 and X3-2
I'm still testing the patch and will put up something on how to patch a virtualized ODA as well as Baremetal steps shortly
The Information Center and various notes on MOS still have not been updated yet with ODA 2.6 information.
As always please test before deploying to production.
WebCenter Partners Week: FishBowl Solutions
As we continue our exploration of WebCenter Partners this week, today we will feature FishBowl Solutions, another fine example of a partner that is adding great value for WebCenter customers.
A disclaimer by necessity: a five day period is relatively short - so it is really impossible to feature all of our partners this week. If you are a partner and feeling left out or a customer that doesn't see your favorite partner featured this week - don't give them grief about it - this is really only a subset of our larger partner community that responded to a quick ping for participation. If you are a partner reading this and have something interesting to add to the conversation for a future feature - please contact me @ michael.snow@oracle.com and we can add you to a future partner-focused week on WebCenter Social channels.
Normal 0 false false false EN-US X-NONE X-NONE MicrosoftInternetExplorer4 /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-family:"Calibri","sans-serif"; mso-bidi-font-family:"Times New Roman";} Access Oracle WebCenter Content on your iPhone or Android with FishbowlToGo
Fishbowl
Solutions has been working with Oracle WebCenter customers since 2010 to extend
WebCenter Content to mobile devices. We started working with mobile sales force
enablement and have since extended our offerings to meet expanding customer
needs. We are excited to announce the release of our newest mobile app, FishbowlToGo.
FishbowlToGo was developed in response to the growing number of customers looking for a way to easily access WebCenter Content and perform basic content management actions from a smart phone. A lot of the organizations we’ve talked to are fighting off ad-hoc adoption of Dropbox or other consumer document management solutions that provide a mobile delivery channel outside the enterprise infrastructure and without the security of WebCenter. FishbowlToGo provides much of the familiar functionality found on these consumer apps within the WebCenter platform.
FishbowlToGo is publically available for iPhone and Android. Any WebCenter Customer can download the app for free and install it on their phone. The free version lets you search for and view content from the Oracle WebCenter Content repository including documents, images, and multimedia. You can also view your workflow queue and set commonly-used items as favorites to quickly access them again. To get started, simply download the app using the links below or search “FishbowlToGo” from the app store – no component or administrator setup is required.
Fishbowl also offers a premium version of the app, which requires a server-side component and provides more robust content management capabilities. With FishbowlToGo Premium, users can review and approve workflow items as well as check in content from their phones. The premium component enables users to pick from configurable upload types such as notes, photos, invoices, etc., and check in those items without filling out lengthy check-in forms from their phones.
FishbowlToGo helps WebCenter customers increase the value of their Oracle WebCenter system by extending content management capabilities to convenient and familiar mobile channels while retaining benefits like consistent access to the up-to-date versions and a secure content repository.
Besides FishbowlToGo, Fishbowl also offers a tablet-based Mobile Library app. We recently did a webinar on this app; for a video recap check out “Inside the Fishbowl” below from our YouTube channel. The full webinar recording is also available. Fishbowl worked with Banner Engineering to deploy this app to iPads and Android tablets last year. Banner recently presented their solution at Collaborate13. The presentation and whitepaper can be found on the Fishbowl Solutions Collaborate13 page. For additional information on this and other mobile solutions for Oracle WebCenter Content visit the links below or email info@fishbowlsolutions.com.
Additional Information
- FishbowlToGo for iPhone on iTunes
- FishbowlToGo for Android on Google Play
- FishbowlToGo Web Page
- Fishbowl Solutions Website
12.00
12.00 Normal 0 false false false false EN-US X-NONE X-NONE -"/> /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-family:"Times New Roman","serif";}
The year of the “back-fill” author…
I recently filled in this years ACE Director self assessment survey. Among other things, as part of that process I check how many articles, blog posts and forum answers I’ve posted over the year.
Whilst getting these numbers I noticed about 50% of articles I put live this year weren’t promoted to the front page as new articles because they were “back-fill”, written on general topics that haven’t really changed over the years. Of the last 6 articles I’ve written, only 1 has made it to the front page as a “new” article. Some of these back-fill articles were prompted by answering readers questions and some by situations that have come up at work. They all go live on the website, but I’d feel silly posting them as a new article. 
Probably the biggest factor in the ratio of back-fill to new material is the delays in the release of 12c database. Each release prompts a rash of new articles and it’s been so long since 11gR2…
Cheers
Tim…
The year of the “back-fill” author… was first posted on May 7, 2013 at 1:28 pm.©2012 "The ORACLE-BASE Blog". Use of this feed is for personal non-commercial use only. If you are not reading this article in your feed reader, then the site is guilty of copyright infringement.
Federated Caching in the world of the 64GB mobile
Experts say the age of big data security analytics has arrived
Companies are collecting mass amounts of data by the second, causing CIOs to seek new technologies and methods to mining information for value. As these enterprises deploy dba services for analyzing big data, experts agree there are immense opportunities for enhancing corporate security.
In a podcast interview with ComputerWeekly, Vigitrust CEO Mathieu Gorge explained that harnessing big data and matching particular points of information gives enterprises endless possibilities for improved security.
"The whole idea behind security in the storage of big data is being able to know where data is, where it is being stored, who has access to it and being able to track it for data protection and compliance…" he explained to the source. "In summary, the best way to do it is to map out the data, have a data flow diagram, classify the data and data points, the correlation of links between those data points, and then apply the standard mix of technical solutions, policies and procedures, and training."
Navigating a complex security landscape
A recent report from the Enterprise Strategy Group (ESG) revealed that one reason corporations are looking to big data for these purposes is that the emergence of IT trends such as cloud computing, social media and bring-your-own-device have created new obstacles for managing security initiatives. Further, nearly one-quarter of organizations faced a security skills shortage in 2012, ESG explained, which has placed new demands on existing staff and technologies. Meanwhile, ESG stressed that the existing security infrastructure has become inadequate, as cybercriminals have new tool sets and tactics at their disposal.
However, database experts can empower firms to mine massive volumes of collected information to gain insight into potential vulnerabilities and security opportunities. According to ESG, 47 percent of enterprises collect, process and analyze more than six terabytes of security data on a monthly basis, which is an increase from two years ago for the majority of organizations. By analyzing this information for real-time security intelligence, firms gain hyper-visibility into all technology layers so risks and susceptibilities are detected more quickly across the enterprise. ESG noted that big data security intelligence thus gives teams the power to prioritize certain actions, adjust security controls and fine-tune incident response. Not only do these practices promote stronger protection of critical information and applications, but these advances can also lower security costs, the report explained.
Security analytics give firms the chance to make more data-driven decisions, which is the key to truly safeguarding information from any possible threat.
RDX's business intelligence and big data experts assist customers in leveraging data contained in large data stores. For more information, please visit our Business Intelligence and Predictive Analytics pages or contact us.
