메뉴 건너뛰기

Cloudera, BigData, Semantic IoT, Hadoop, NoSQL

Cloudera CDH/CDP 및 Hadoop EcoSystem, Semantic IoT등의 개발/운영 기술을 정리합니다. gooper@gooper.com로 문의 주세요.


1. 현재 연결된 기기 확인

(아래는 31.7GB(/dev/mmcblk0)과 1000.2 GB(/dev/sda)의 2개의 외장기기 확인됨

   /dev/mmcblk0는 /dev/mmcblk0p1과 /dev/mmcblk0p2의 2개 파티션으로 구성 되어 있고

          /dev/sda는 /dev/sda1로 파티션 1개로 구성되어 있음)

root@slave1:~# fdisk -l

Disk /dev/mmcblk0: 31.7 GB, 31657558016 bytes
4 heads, 16 sectors/track, 966112 cylinders, total 61831168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xf7e9dfe5

        Device Boot      Start         End      Blocks   Id  System
/dev/mmcblk0p1            2048       40960       19456+  81  Minix / old Linux
/dev/mmcblk0p2           40961     7577599     3768319+  81  Minix / old Linux

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0xc197d009

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1            2048  1953521663   976759808    7  HPFS/NTFS/exFAT

 

2. device에 mount할 폴더 생성

root@slave1:~# mkdir /app
root@slave1:~# mkdir /app/usb
root@slave1:~# mkdir /app/usb2
root@slave1:~# mkdir /app/hdd

 

3. hdd는 인식가능하게 파티션을 생성해야함..

root@slave1:/# fdisk /dev/sda

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel with disk identifier 0xb092454e.

Changes will remain in memory only, until you decide to write them.

After that, of course, the previous content won't be recoverable.


Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)


The device presents a logical sector size that is smaller than

the physical sector size. Aligning to a physical sector (or optimal

I/O) size boundary is recommended, or performance may be impacted.


Command (m for help): o

Building a new DOS disklabel with disk identifier 0xb5607451.

Changes will remain in memory only, until you decide to write them.

After that, of course, the previous content won't be recoverable.


Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)


The device presents a logical sector size that is smaller than

the physical sector size. Aligning to a physical sector (or optimal

I/O) size boundary is recommended, or performance may be impacted.


Command (m for help): n

Partition type:

   p   primary (0 primary, 0 extended, 4 free)

   e   extended

Select (default p): p

Partition number (1-4, default 1): 

Using default value 1

First sector (2048-1953525167, default 2048): 

Using default value 2048

Last sector, +sectors or +size{K,M,G} (2048-1953525167, default 1953525167): 

Using default value 1953525167


Command (m for help): w

The partition table has been altered!


Calling ioctl() to re-read partition table.

Syncing disks.


4. 작성된 파티션을 사용하기 위해 파일시스템을 생성한다.

(아래는 전체를 파티션 1개로 설정한 경우임)

root@slave1:/# mkfs -t ext4 /dev/sda1

mke2fs 1.42.5 (29-Jul-2012)

Filesystem label=

OS type: Linux

Block size=4096 (log=2)

Fragment size=4096 (log=2)

Stride=0 blocks, Stripe width=0 blocks

61054976 inodes, 244190390 blocks

12209519 blocks (5.00%) reserved for the super user

First data block=0

Maximum filesystem blocks=0

7453 block groups

32768 blocks per group, 32768 fragments per group

8192 inodes per group

Superblock backups stored on blocks: 

        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, 

        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968, 

        102400000, 214990848


Allocating group tables: done                            

Writing inode tables: done                            

Creating journal (32768 blocks): done

Writing superblocks and filesystem accounting information: done     


*파티션 정보 확인

root@slave1:/# fdisk -l


Disk /dev/sda: 1000.2 GB, 1000204886016 bytes

81 heads, 63 sectors/track, 382818 cylinders, total 1953525168 sectors

Units = sectors of 1 * 512 = 512 bytes

Sector size (logical/physical): 512 bytes / 4096 bytes

I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk identifier: 0xb5607451


   Device Boot      Start         End      Blocks   Id  System

/dev/sda1            2048  1953525167   976761560   83  Linux


Disk /dev/mmcblk0: 31.7 GB, 31657558016 bytes

4 heads, 16 sectors/track, 966112 cylinders, total 61831168 sectors

Units = sectors of 1 * 512 = 512 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xf7e9dfe5


        Device Boot      Start         End      Blocks   Id  System

/dev/mmcblk0p1            2048       40960       19456+  81  Minix / old Linux

/dev/mmcblk0p2           40961     7577599     3768319+  81  Minix / old Linux

root@slave1:/# fdisk -l


Disk /dev/sda: 1000.2 GB, 1000204886016 bytes

81 heads, 63 sectors/track, 382818 cylinders, total 1953525168 sectors

Units = sectors of 1 * 512 = 512 bytes

Sector size (logical/physical): 512 bytes / 4096 bytes

I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk identifier: 0xb5607451


   Device Boot      Start         End      Blocks   Id  System

/dev/sda1            2048  1953525167   976761560   83  Linux


Disk /dev/mmcblk0: 31.7 GB, 31657558016 bytes

4 heads, 16 sectors/track, 966112 cylinders, total 61831168 sectors

Units = sectors of 1 * 512 = 512 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xf7e9dfe5


        Device Boot      Start         End      Blocks   Id  System

/dev/mmcblk0p1            2048       40960       19456+  81  Minix / old Linux

/dev/mmcblk0p2           40961     7577599     3768319+  81  Minix / old Linux


5. device와 폴더 연결(mount)

root@slave1:/# mount /dev/sda1 /app/hdd

 

6. 자동 mount설정

 vi /etc/fstab에 아래의 내용을 추가한다.

 

 /dev/sda1       /app/hdd        ext4    defaults        0       0


번호 제목 날짜 조회 수
87 FAILED: IllegalStateException Variable substitution depth too large: 40 오류발생시 조치사항 2014.08.19 2520
86 원보드 컴퓨터 비교표 file 2014.08.04 1681
» 외부 기기(usb, 하드)등 mount(연결)하기 2014.08.03 1448
84 데이타 제공 사이트 링크 2014.08.03 2221
83 lubuntu 호스트 네임변경 2014.08.03 1745
82 oozie 에서 sqoop action실행 에러 - 컬럼개수 차이 2014.07.17 1972
81 uEnv.txt위치및 내용 2014.07.09 1512
80 banana pi(lubuntu)에서 한글 설정및 한글깨짐 문제 해결 2014.07.06 4268
79 access=WRITE, inode="staging":ubuntu:supergroup:rwxr-xr-x 오류 2014.07.05 2762
78 org.apache.hadoop.security.AccessControlException: Permission denied: user=hadoop, access=WRITE, inode="":root:supergroup:rwxr-xr-x 오류 처리방법 2014.07.05 3693
77 banana pi에(lubuntu)에 hadoop설치하고 테스트하기 - 성공 file 2014.07.05 3730
76 2개 data를 join하고 마지막으로 code정보를 join하여 결과를 얻는 mr 프로그램 2014.06.30 1284
75 jsoup 사용 예제 2014.06.06 2646
74 Cannot create /var/run/oozie/oozie.pid: Directory nonexistent오류 2014.06.03 2331
73 oozie job 구동시 JA009: User: hadoop is not allowed to impersonate hadoop 오류나는 경우 2014.06.02 1863
72 원보드pc인 bananapi를 이용하여 hadoop 클러스터 구성하기(준비물) file 2014.05.29 4759
71 의사분산모드에 hadoop설치및 ecosystem 환경 정리 2014.05.29 3924
70 hadoop및 ecosystem에서 사용되는 명령문 정리 2014.05.28 4696
69 hive job실행시 meta정보를 원격의 mysql에 저장하는 경우 설정방법 2014.05.28 2095
68 oozie의 meta정보를 mysql에서 관리하기 2014.05.26 2586
위로