mongodb – PHPor 的Blog

PHP连接mongodb

5,496

11月 212012

PHP的mongo模块使用域名访问mongodb时，其连接池是用域名做key来记录长连接的

...
  'gm9004.mars.grid.sina.com.cn:9004....28953' => 
  array (
    'in use' => 0,
    'in pool' => 1,
    'remaining' => -2,
    'total' => -1,
    'timeout' => 498,
    'waiting' => 0,
  ),
  'gm9002.mars.grid.sina.com.cn:9002....28953' => 
  array (
    'in use' => 0,
    'in pool' => 1,
    'remaining' => -2,
    'total' => -1,
    'timeout' => 498,
    'waiting' => 0,
  ),
...

...

'gm9004.mars.grid.sina.com.cn:9004....28953' =>

array (

'in use' => 0,

'in pool' => 1,

'remaining' => -2,

'total' => -1,

'timeout' => 498,

'waiting' => 0,

'gm9002.mars.grid.sina.com.cn:9002....28953' =>

array (

'in use' => 0,

'in pool' => 1,

'remaining' => -2,

'total' => -1,

'timeout' => 498,

'waiting' => 0,

...

原文链接：https://phpor.net/blog/post/1509

当mongodb超过最大连接数

mongodb No Responses »

2,458

7月 212012

要解决的问题：

使用PHP 的mongo模块连接mongodb时，可能会出现打开的文件描述符未关闭的情况，直到文件描述符的数量达到limit的限制而出错。

启动mongod，设置最大连接数为5（方便调试）：

 mongod --fork --port 9002 --bind_ip 10.55.38.114 --dbpath /data1/mongodb_data/ --logpath /data1/mongolog/mongo9002.log --maxConns 5

1	mongod --fork --port 9002 --bind_ip 10.55.38.114 --dbpath /data1/mongodb_data/ --logpath /data1/mongolog/mongo9002.log --maxConns 5

消费连接数：

#nc 10.55.38.114 9002&
#nc 10.55.38.114 9002&
#nc 10.55.38.114 9002&
#nc 10.55.38.114 9002&
#nc 10.55.38.114 9002&

#nc 10.55.38.114 9002&

测试脚本mongo.php：

<?php

while(1) {
        try{
                $mo = new Mongo("mongodb://10.55.38.114:9002/phpor", array("timeout"=>2000));
                $modb = $mo->selectDB("phpor");
                $mocl = $modb->selectCollection("phpor_0");
                $cursor = $mocl->find(array("_id"=>2258319125));
                $arr = $cursor->getNext();
                print_r($arr);
        }catch(Exception $e){
                //var_dump($e);
                echo $e->getCode() ,":", $e->getMessage(), "\n";
                sleep(1);
                }
        unset($mo);

}

<?php

while(1) {

try{

$mo = new Mongo("mongodb://10.55.38.114:9002/phpor", array("timeout"=>2000));

$modb = $mo->selectDB("phpor");

$mocl = $modb->selectCollection("phpor_0");

$cursor = $mocl->find(array("_id"=>2258319125));

$arr = $cursor->getNext();

print_r($arr);

}catch(Exception $e){

//var_dump($e);

echo $e->getCode() ,":", $e->getMessage(), "\n";

sleep(1);

}

unset($mo);

}

测试：

php mongo.php

1	php mongo.php

发现错误信息（结果却还是没有出现文件描述符未关闭的情况）：

19:max number of retries exhausted, couldn’t send query
4:couldn’t get response header

原文链接：https://phpor.net/blog/post/1100

PHP的mongo模块连接失败的处理

mongodb No Responses »

2,299

7月 152012

实例代码：

<?php
try{    
	$mo = new Mongo("mongodb://10.55.38.18:1234/phpor", array("timeout"=>2000));
}catch(Exception $e){
	echo $e->getCode() ,":", $e->getMessage(), "\n";
}       
echo "connect ok\n";
?>

<?php

try{

$mo = new Mongo("mongodb://10.55.38.18:1234/phpor", array("timeout"=>2000));

}catch(Exception $e){

echo $e->getCode() ,":", $e->getMessage(), "\n";

}

echo "connect ok\n";

当IP地址可以ping通，但是端口未开启时（直接返回Reset数据包），返回错误信息为：
错误号： 0；错误信息：Transport endpoint is not connected
当IP地址不能ping通，或者发送syn数据包，但是不能收到Reset或sys-act数据包时，返回错误信息为：
错误号： 0；错误信息： Operation now in progress

原文链接：https://phpor.net/blog/post/1076

关于mongodb的db.stats()

mongodb No Responses »

9,430

3月 172012

关于mongodb的db.stats() 的解释：

其中：
collections：集合的个数
objects: 对象的个数，循环每个集合得到的，每个集合的记录数（nrecords）之和
avgObjSize：平均每个对象的大小，通过 dataSize / objects 得到
dataSize：每个集合的dataSize之和
storageSize: 每个集合的storageSize之和
fileSize： db下面的物理存储文件的大小；物理存储文件比实际的数据要大一些，这是是mongo的预分配机制

这里最难理解的大概就是 storageSize了，它和dataSize的差异参看： http://blog.nosqlfan.com/html/2654.html

相关代码db\dbcommands.cpp：

bool run(const string& dbname, BSONObj& jsobj, string& errmsg, BSONObjBuilder& result, bool fromRepl ) {
    list<string> collections;
    Database* d = cc().database();
    if ( d )
        d->namespaceIndex.getNamespaces( collections );
    longlong ncollections = 0;
    longlong objects = 0;
    longlong size = 0;
    longlong storageSize = 0;
    longlong numExtents = 0;
    longlong indexes = 0;
    longlong indexSize = 0;
    for (list<string>::const_iterator it = collections.begin(); it != collections.end(); ++it) {
        const string ns = *it;
        NamespaceDetails * nsd = nsdetails( ns.c_str() );
        if ( ! nsd ) {
            errmsg = "missing ns: ";
            errmsg += ns;
            returnfalse;
        }
        ncollections += 1;
        objects += nsd->stats.nrecords;
        size += nsd->stats.datasize;
        int temp;
        storageSize += nsd->storageSize( &temp );
        numExtents += temp;
        indexes += nsd->nIndexes;
        indexSize += getIndexSizeForCollection(dbname, ns);
    }

    result.append      ( "db" , dbname );
    result.appendNumber( "collections" , ncollections );
    result.appendNumber( "objects" , objects );
    result.append      ( "avgObjSize" , objects == 0 ? 0 : double(size) / double(objects) );
    result.appendNumber( "dataSize" , size );
    result.appendNumber( "storageSize" , storageSize);
    result.appendNumber( "numExtents" , numExtents );
    result.appendNumber( "indexes" , indexes );
    result.appendNumber( "indexSize" , indexSize );
    result.appendNumber( "fileSize" , d->fileSize() );
    returntrue;
}
dDBStats;

bool run(const string& dbname, BSONObj& jsobj, string& errmsg, BSONObjBuilder& result, bool fromRepl ) {

list<string> collections;

Database* d = cc().database();

if ( d )

d->namespaceIndex.getNamespaces( collections );

longlong ncollections = 0;

longlong objects = 0;

longlong size = 0;

longlong storageSize = 0;

longlong numExtents = 0;

longlong indexes = 0;

longlong indexSize = 0;

for (list<string>::const_iterator it = collections.begin(); it != collections.end(); ++it) {

const string ns = *it;

NamespaceDetails * nsd = nsdetails( ns.c_str() );

if ( ! nsd ) {

errmsg = "missing ns: ";

errmsg += ns;

returnfalse;

}

ncollections += 1;

objects += nsd->stats.nrecords;

size += nsd->stats.datasize;

int temp;

storageSize += nsd->storageSize( &temp );

numExtents += temp;

indexes += nsd->nIndexes;

indexSize += getIndexSizeForCollection(dbname, ns);

}

result.append ( "db" , dbname );

result.appendNumber( "collections" , ncollections );

result.appendNumber( "objects" , objects );

result.append ( "avgObjSize" , objects == 0 ? 0 : double(size) / double(objects) );

result.appendNumber( "dataSize" , size );

result.appendNumber( "storageSize" , storageSize);

result.appendNumber( "numExtents" , numExtents );

result.appendNumber( "indexes" , indexes );

result.appendNumber( "indexSize" , indexSize );

result.appendNumber( "fileSize" , d->fileSize() );

returntrue;

}

dDBStats;

longlong Database::fileSize() const {
    longlong size=0;
    for (int n=0; exists(n); n++)
        size += boost::filesystem::file_size( fileName(n) );
    return size;
}

longlong Database::fileSize() const {

longlong size=0;

for (int n=0; exists(n); n++)

size += boost::filesystem::file_size( fileName(n) );

return size;

}

        bool run(const string&amp; dbname, BSONObj&amp; jsobj, string&amp; errmsg, BSONObjBuilder&amp; result, bool fromRepl ) {             list&lt;string&gt; collections;             Database* d = cc().database();             if ( d )                 d-&gt;namespaceIndex.getNamespaces( collections );              long long ncollections = 0;             long long objects = 0;             long long size = 0;             long long storageSize = 0;             long long numExtents = 0;             long long indexes = 0;             long long indexSize = 0;              for (list&lt;string&gt;::const_iterator it = collections.begin(); it != collections.end(); ++it) {                 const string ns = *it;                  NamespaceDetails * nsd = nsdetails( ns.c_str() );                 if ( ! nsd ) {                     errmsg = "missing ns: ";                     errmsg += ns;                     return false;                 }                  ncollections += 1;                 objects += nsd-&gt;stats.nrecords;                 size += nsd-&gt;stats.datasize;                  int temp;                 storageSize += nsd-&gt;storageSize( &amp;temp );                 numExtents += temp;                  indexes += nsd-&gt;nIndexes;                 indexSize += getIndexSizeForCollection(dbname, ns);             }                          result.append      ( "db" , dbname );             result.appendNumber( "collections" , ncollections );             result.appendNumber( "objects" , objects );             result.append      ( "avgObjSize" , objects == 0 ? 0 : double(size) / double(objects) );             result.appendNumber( "dataSize" , size );             result.appendNumber( "storageSize" , storageSize);             result.appendNumber( "numExtents" , numExtents );             result.appendNumber( "indexes" , indexes );             result.appendNumber( "indexSize" , indexSize );             result.appendNumber( "fileSize" , d-&gt;fileSize() );              return true;         }     } cmdDBStats;

bool run(const string& dbname, BSONObj& jsobj, string& errmsg, BSONObjBuilder& result, bool fromRepl ) { list<string> collections; Database* d = cc().database(); if ( d ) d->namespaceIndex.getNamespaces( collections ); long long ncollections = 0; long long objects = 0; long long size = 0; long long storageSize = 0; long long numExtents = 0; long long indexes = 0; long long indexSize = 0; for (list<string>::const_iterator it = collections.begin(); it != collections.end(); ++it) { const string ns = *it; NamespaceDetails * nsd = nsdetails( ns.c_str() ); if ( ! nsd ) { errmsg = "missing ns: "; errmsg += ns; return false; } ncollections += 1; objects += nsd->stats.nrecords; size += nsd->stats.datasize; int temp; storageSize += nsd->storageSize( &temp ); numExtents += temp; indexes += nsd->nIndexes; indexSize += getIndexSizeForCollection(dbname, ns); } result.append ( "db" , dbname ); result.appendNumber( "collections" , ncollections ); result.appendNumber( "objects" , objects ); result.append ( "avgObjSize" , objects == 0 ? 0 : double(size) / double(objects) ); result.appendNumber( "dataSize" , size ); result.appendNumber( "storageSize" , storageSize); result.appendNumber( "numExtents" , numExtents ); result.appendNumber( "indexes" , indexes ); result.appendNumber( "indexSize" , indexSize ); result.appendNumber( "fileSize" , d->fileSize() ); return true; } } cmdDBStats;

boost::filesystem::path Database::fileName( int n ) const {
    stringstream ss;
    ss << name << '.' << n;
    boost::filesystem::path fullName;
    fullName = boost::filesystem::path(path);
    if ( directoryperdb )
        fullName /= name;
    fullName /= ss.str();
    return fullName;
}

boost::filesystem::path Database::fileName( int n ) const {

stringstream ss;

ss << name << '.' << n;

boost::filesystem::path fullName;

fullName = boost::filesystem::path(path);

if ( directoryperdb )

fullName /= name;

fullName /= ss.str();

return fullName;

}

原文链接：https://phpor.net/blog/post/971

关于mongodb

mongodb No Responses »

14,939

2月 062012

1. 关于mongodb的遍历
db.phpor.test.find();
it

如：

2. mongodb可以在server端保存js，这样一些业务逻辑就可以使用js来写了，而且算法也不需要总是通过网络传递

原文链接：https://phpor.net/blog/post/968

关于mongo的安装

mongodb No Responses »

4,925

6月 182011

* 比较方便的办法是下载一个合适的二进制的mongodb的包，直接复制到合适的目录
* 自己编译安装：

首先， mongodb的编译是通过scons来构建的，所以要先安装scons，参考： http://www.scons.org/
scons 是一个python工具，所以你要先安装python
假设你上面的已经安装成功了
mongodb还依赖下面东西：

devel/boost

devel/libexecinfo

devel/pcre

lang/spidermonkey

5. 假设你安装完了上面依赖，好了， scons . ; 但愿你是幸运的

——————–
提示： boost安装可以使用yum：
yum install boost-devel

pcre的安装： http://www.pcre.org/

spidermonkey的安装: http://www.mongodb.org/display/DOCS/Building+Spider+Monkey

重要： gcc < 4编译不行

原文链接：https://phpor.net/blog/post/851